-- Logs begin at Fri 2022-09-16 01:14:26 UTC, end at Fri 2022-09-16 02:24:22 UTC. -- Sep 16 01:45:21.493241 dv-cinder-849143-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 16 01:45:21.504993 dv-cinder-849143-2-iscsi devstack@n-api.service[105430]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 16 01:45:21.506967 dv-cinder-849143-2-iscsi devstack@n-api.service[105430]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 16 01:45:21 2022] *** Sep 16 01:45:21.506967 dv-cinder-849143-2-iscsi devstack@n-api.service[105430]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 16 01:45:21.506967 dv-cinder-849143-2-iscsi devstack@n-api.service[105430]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 16 01:45:21.506967 dv-cinder-849143-2-iscsi devstack@n-api.service[105430]: nodename: dv-cinder-849143-2-iscsi Sep 16 01:45:21.506967 dv-cinder-849143-2-iscsi devstack@n-api.service[105430]: machine: x86_64 Sep 16 01:45:21.506967 dv-cinder-849143-2-iscsi devstack@n-api.service[105430]: clock source: unix Sep 16 01:45:21.506967 dv-cinder-849143-2-iscsi devstack@n-api.service[105430]: pcre jit disabled Sep 16 01:45:21.506967 dv-cinder-849143-2-iscsi devstack@n-api.service[105430]: detected number of CPU cores: 4 Sep 16 01:45:21.506967 dv-cinder-849143-2-iscsi devstack@n-api.service[105430]: current working directory: / Sep 16 01:45:21.506967 dv-cinder-849143-2-iscsi devstack@n-api.service[105430]: detected binary path: /usr/bin/uwsgi-core Sep 16 01:45:21.507721 dv-cinder-849143-2-iscsi devstack@n-api.service[105430]: your processes number limit is 47680 Sep 16 01:45:21.507721 dv-cinder-849143-2-iscsi devstack@n-api.service[105430]: your memory page size is 4096 bytes Sep 16 01:45:21.507721 dv-cinder-849143-2-iscsi devstack@n-api.service[105430]: detected max file descriptor number: 2048 Sep 16 01:45:21.507721 dv-cinder-849143-2-iscsi devstack@n-api.service[105430]: lock engine: pthread robust mutexes Sep 16 01:45:21.507721 dv-cinder-849143-2-iscsi devstack@n-api.service[105430]: thunder lock: enabled Sep 16 01:45:21.507721 dv-cinder-849143-2-iscsi devstack@n-api.service[105430]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 16 01:45:21.507721 dv-cinder-849143-2-iscsi devstack@n-api.service[105430]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 16 01:45:21.545467 dv-cinder-849143-2-iscsi devstack@n-api.service[105430]: Python main interpreter initialized at 0x561493bb79c0 Sep 16 01:45:21.545467 dv-cinder-849143-2-iscsi devstack@n-api.service[105430]: python threads support enabled Sep 16 01:45:21.545467 dv-cinder-849143-2-iscsi devstack@n-api.service[105430]: your server socket listen backlog is limited to 100 connections Sep 16 01:45:21.545467 dv-cinder-849143-2-iscsi devstack@n-api.service[105430]: your mercy for graceful operations on workers is 90 seconds Sep 16 01:45:21.545801 dv-cinder-849143-2-iscsi devstack@n-api.service[105430]: mapped 403077 bytes (393 KB) for 2 cores Sep 16 01:45:21.545883 dv-cinder-849143-2-iscsi devstack@n-api.service[105430]: *** Operational MODE: preforking *** Sep 16 01:45:21.546112 dv-cinder-849143-2-iscsi devstack@n-api.service[105430]: *** uWSGI is running in multiple interpreter mode *** Sep 16 01:45:21.546112 dv-cinder-849143-2-iscsi devstack@n-api.service[105430]: spawned uWSGI master process (pid: 105430) Sep 16 01:45:21.550360 dv-cinder-849143-2-iscsi devstack@n-api.service[105430]: spawned uWSGI worker 1 (pid: 105431, cores: 1) Sep 16 01:45:21.550360 dv-cinder-849143-2-iscsi devstack@n-api.service[105430]: spawned uWSGI worker 2 (pid: 105432, cores: 1) Sep 16 01:45:21.550360 dv-cinder-849143-2-iscsi devstack@n-api.service[105430]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 16 01:45:21.546303 dv-cinder-849143-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 16 01:45:22.200843 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 16 01:45:22.201447 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 16 01:45:23.281227 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 01:45:23.281227 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: from cryptography.utils import int_from_bytes Sep 16 01:45:23.281920 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 01:45:23.281920 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: from cryptography.utils import int_from_bytes Sep 16 01:45:23.282039 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 01:45:23.282039 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: from cryptography.utils import int_from_bytes Sep 16 01:45:23.282039 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 01:45:23.282039 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: from cryptography.utils import int_from_bytes Sep 16 01:45:25.804644 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 16 01:45:25.805191 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 16 01:45:25.805424 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 16 01:45:25.805787 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 16 01:45:25.806043 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 16 01:45:25.806429 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.806752 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.806930 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 16 01:45:25.807284 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.807355 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 16 01:45:25.807432 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.807687 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.807779 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 16 01:45:25.808021 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.808127 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 16 01:45:25.808322 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 16 01:45:25.808922 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.808922 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.809070 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.809148 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.809234 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.809313 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.809397 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.809475 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.809614 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.809794 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849143-2-iscsi {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.809973 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.810114 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.810275 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.810420 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.810563 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.810728 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.810877 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.811041 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.811199 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.811335 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.811484 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.811652 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.811771 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.811971 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.812117 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849143-2-iscsi {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.812433 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.812521 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.812734 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.812895 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.813035 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.813201 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.813345 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.813508 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.813648 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.813847 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.813950 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.814161 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.814264 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.814467 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.815384 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.815491 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.815806 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.815895 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.816161 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.816330 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.816511 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.816628 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.816875 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849143-2-iscsi {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.816989 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.817190 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.817281 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.817500 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.817598 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.817811 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.817907 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.818148 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.818286 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.818466 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.818564 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.818771 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.818864 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.819109 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.819200 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849143-2-iscsi {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.819431 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.819523 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.819737 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.819836 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.820067 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.820157 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.820391 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.820475 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.820708 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.820809 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.821027 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.821119 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.821325 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.821409 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.821631 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.821723 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.821937 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.822029 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.822255 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.822356 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.822560 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.822652 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.822862 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.822961 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.823113 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.823219 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.823414 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.823502 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.823731 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.823823 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.824057 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.824148 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.824374 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.824468 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.824628 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.824726 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.824878 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.824982 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.825189 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.825280 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.825490 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.825580 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.825792 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.825885 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.826096 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.826182 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.826399 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.826490 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.826644 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.826729 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.826890 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.826983 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.827201 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.827292 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.827512 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.827605 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.827812 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.827904 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.828138 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.828224 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.828439 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.828526 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.828738 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.828824 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.829038 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.829131 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.829335 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.829419 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.829634 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.829757 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.829933 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.830034 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.830585 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.830687 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.830687 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.830841 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.831016 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.831183 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.831325 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.831494 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.831641 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.831817 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.831978 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.832243 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.832332 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.832494 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.832578 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.832802 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.832990 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.833204 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.833308 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.833451 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.833544 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.833759 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.833856 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.834014 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.834098 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.834317 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.834458 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.834621 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.834719 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.834936 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.835028 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.835240 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.835324 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.835540 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.835636 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.835844 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.835930 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.836166 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.836250 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.836423 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.836524 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.836721 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.836806 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.837019 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.837103 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.837331 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.837416 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.837631 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.837724 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.837928 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.838010 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.838226 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.838311 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.838518 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.838600 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.838825 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.839005 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.839141 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.839230 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.839399 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.839484 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.839699 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.839789 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.840021 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.840125 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.840327 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.840412 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.840625 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.840720 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.840924 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.841016 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.841222 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.841306 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.841518 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.841604 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.841831 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.841916 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.842143 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.842227 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.842441 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.842533 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.842739 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.842850 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.843035 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.843123 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.843335 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.843420 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.843636 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.843739 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.843945 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.844031 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.844258 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.844352 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.844559 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.844638 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.844860 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.844954 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.845157 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.845249 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.845455 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.845546 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.845754 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.845838 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.846178 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.846279 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.846491 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.846672 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.846802 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.846885 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.847084 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.847217 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.847385 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.847531 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.847682 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.847832 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.848028 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.848159 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.848349 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.848461 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.848656 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.848761 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.848962 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.849048 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.849264 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.849351 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.849577 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.849663 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.849911 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.849997 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.850208 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.850290 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.850522 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.850615 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.850839 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.850926 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.851145 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.851229 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.851446 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.851546 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.851745 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.851839 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.852085 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:45:25.852173 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.852405 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.852499 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.852727 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.852838 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.853035 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.853119 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.853341 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.853434 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.853648 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.853739 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.853966 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.854059 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.854275 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.854360 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.854581 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.854664 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.854888 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.854971 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.855199 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.855375 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.855501 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.855586 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.855804 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.855898 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.856133 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.856240 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.856444 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.856529 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.856754 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.856842 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.857061 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.857156 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.857377 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.857469 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.857689 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.857780 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.858000 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.858086 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.858305 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.858390 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.858615 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.858707 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.858926 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.859011 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.859232 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.859317 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.859536 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.859619 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.859872 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.860006 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.860206 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.860290 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.860518 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.860612 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.860837 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.860929 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.861147 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.861232 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.861450 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.862085 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.862308 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.862475 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.862605 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.862918 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.863028 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.863269 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.863358 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.863583 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.863667 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.863894 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.864031 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.864234 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.864321 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.864543 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.864626 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.864862 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.864954 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.865170 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.865254 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.865475 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.865559 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.865780 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.865880 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.866085 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.866170 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.866390 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.866483 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.866693 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.866792 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.866995 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.867080 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.867298 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.867389 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.867606 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.867705 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.867910 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.868062 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.868247 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.868334 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.868553 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.868646 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.868858 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.868943 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.869161 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.869290 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.869461 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.869554 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.869757 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.869841 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.870057 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.870141 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.870363 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.870449 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.870664 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.870754 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.870974 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.871066 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.871318 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.871405 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.871625 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.871713 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.871975 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.872065 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.872281 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.872367 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.872581 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.872666 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.872886 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.872982 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.873190 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.873284 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.873487 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.873571 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.873792 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.873885 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.874097 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.874181 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.874393 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.874475 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.874708 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.874799 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.875009 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.875094 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.875309 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.875394 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.875620 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.875717 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.875917 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.876028 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.876240 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.876325 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.876549 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.876636 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.876852 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.876936 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.877229 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.877316 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.877678 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.877771 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.878001 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.878210 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.878301 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.878534 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.878633 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.878843 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.878937 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.879151 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.879235 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.879459 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.879560 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.879765 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.879849 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.880092 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.880181 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.880393 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.880481 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.880694 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.880786 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.880992 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.881077 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.881292 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.881377 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.881593 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.881677 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.881891 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.881988 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.882192 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.882299 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.882491 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.882607 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.882790 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.882911 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.883127 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.883216 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.883428 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.883514 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.883764 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.883858 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.884084 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.884421 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.884639 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.884722 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.884956 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.885097 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.885259 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.885347 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.885557 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.885641 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.885857 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.885968 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.886155 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.886247 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.886468 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.886559 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.886777 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.886874 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.887092 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.887176 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.887402 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.887486 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.887717 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.887804 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.888047 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.888137 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.888355 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.888450 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.888663 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.888749 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.888965 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.889049 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.889266 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.889350 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.889569 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.889653 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.889873 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.889957 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.890186 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.890271 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.890490 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.890576 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.890809 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.890900 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.891112 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.891205 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.891420 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.891504 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.891724 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.891806 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.892060 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.892164 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.892362 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.892446 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.892665 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.893286 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.893511 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.893654 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.893817 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.894132 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.894217 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.894438 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.894532 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.894757 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.894884 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.895067 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.895197 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.895381 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.895466 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.895681 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.895767 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.896011 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.896100 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.896322 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.896430 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.896627 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.896713 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.896939 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.897022 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.897243 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.897337 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.897555 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.897640 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.897858 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.897942 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.898162 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.898258 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.898465 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.898550 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.898765 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.898848 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.899059 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.899151 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.899365 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.899456 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.899675 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.899767 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.900011 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.900100 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.900316 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.900400 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.900615 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.900710 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.900926 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.901013 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.901230 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.901313 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.901530 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.901614 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.901828 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.901914 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.902124 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.902207 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.902423 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.902508 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.902726 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.902812 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.903034 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.903119 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.903338 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.903436 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.903637 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.903720 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.903968 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.904056 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.904262 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.904364 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.904566 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.904660 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.904863 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.904987 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.905161 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.905299 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.905458 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.905542 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.905769 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.905863 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.906074 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.906168 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.906375 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.906458 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.906688 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.906773 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.906983 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.907079 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.907281 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.907372 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.907594 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.907686 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.907894 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.908001 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.908219 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.908306 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.908619 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.908714 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.908934 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.909229 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.909320 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.909535 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.909627 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.909842 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.909936 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.910148 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.910233 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.910454 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.910546 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.910771 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.910872 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.911077 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.911161 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.911382 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.911468 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.911684 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.911769 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.912007 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.912096 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.912316 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.912402 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.912622 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.912715 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.912926 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.913188 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.913273 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.913519 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.913612 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.913819 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.913902 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.914122 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.914214 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.914439 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.914536 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.914744 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.914839 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.915048 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.915134 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.915350 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.915434 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.915648 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.915734 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.915971 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.916059 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.916285 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.916386 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.916589 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.916844 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.916929 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.917182 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.917274 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.917480 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.917566 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.917781 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.917866 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.918081 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.918165 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.918388 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.918486 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.918690 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.918776 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.918989 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.919084 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.919290 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.919389 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.919591 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.919684 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.919905 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.920014 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.920234 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.920332 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.920545 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.920630 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.920849 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.920945 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.921157 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.921252 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.921458 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.921554 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.921758 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.921843 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.922060 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.922145 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.922359 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.922444 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.922656 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.922740 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.922951 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.923037 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.923250 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.923342 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.923559 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.923643 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.923856 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.924614 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.924751 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.924878 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.925191 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.925286 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.925521 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.925607 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.925830 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.925929 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.926133 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.926231 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.926436 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.926529 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.926743 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.926828 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.927051 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.927154 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.927353 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.927445 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.927661 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.927747 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.927987 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.928090 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.928301 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.928388 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.928607 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.928699 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.928908 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.928994 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.929214 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.929306 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.929515 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.929600 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.929818 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.929910 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.930115 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.930200 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.930414 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.930499 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.930710 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.930796 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.931006 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.931103 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.931309 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.931394 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.931608 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.931701 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.931907 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.932023 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.932231 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.932327 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.932526 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.932611 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.932827 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.932912 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.933125 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.933230 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.933423 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.933514 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.933720 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.933817 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.934017 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.934176 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.934314 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.934399 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.934615 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.934705 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.934914 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.935015 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.935210 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.935340 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.935509 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.935594 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.935801 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.935887 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.936129 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.936215 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.936428 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.936515 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.936722 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.936809 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.937020 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.937105 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.937320 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.937406 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.937620 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.937720 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.937915 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.938001 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.938213 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.938296 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.938514 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.938600 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.938808 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.938891 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.939104 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.939197 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.939398 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.939482 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.939763 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.939859 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.940068 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.940346 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.940434 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.940660 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.940746 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.940978 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.941063 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.941282 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.941414 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.941582 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.941669 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.941881 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.941966 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.942179 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.942264 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.942478 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.942563 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.942775 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.942868 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.943096 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.943183 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.943375 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.943460 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.943673 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.943778 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.943990 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.944090 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.944291 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.944377 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.944589 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.944683 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.944903 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.944994 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.945206 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.945290 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.945505 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.945597 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.945803 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.945892 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.946098 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.946192 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.946406 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.946504 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.946709 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.946794 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.947027 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.947119 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.947336 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.947423 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.947642 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.947732 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.947976 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.948094 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.948288 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.948378 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.948597 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.948682 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.948896 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.948979 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.949191 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.949276 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.949493 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.949576 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.949795 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.949906 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.950099 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.950185 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.950391 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.950476 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.950688 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.950786 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.950995 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.951078 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.951295 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.951385 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.951598 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.951690 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.951904 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.952069 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.952228 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.952319 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.952534 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.952629 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.952828 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.952919 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.953129 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.953214 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.953430 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.953523 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.953731 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.953816 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.954031 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.954152 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.954330 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.954416 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.954630 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.954714 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.954932 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.955015 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.955726 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.955894 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.956189 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.956276 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.956502 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.956656 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.956811 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.956968 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.957113 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.957262 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.957421 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.957570 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.957730 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.957874 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.958043 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.958195 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.958355 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.958502 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.958657 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.958804 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.959066 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.959151 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.959374 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.959471 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.959684 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.959769 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.960010 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.960106 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.960313 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.960433 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.960614 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.960739 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.960921 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.961047 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.961241 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.961335 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.961541 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.961625 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.961841 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.961925 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.962141 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.962235 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.962460 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.962547 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.962760 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.962845 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.963076 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.963197 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.963485 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.963569 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.963793 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.963878 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.964122 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.964249 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.964421 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.964533 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.964717 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.964841 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.965021 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.965146 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.965338 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.965463 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.965637 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.965793 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.965934 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.966090 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.966230 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.966394 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.966559 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.966703 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.966842 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.967009 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.967157 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.967329 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.967564 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.967649 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.967870 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.967988 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.968198 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.968283 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.968550 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.968635 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.968870 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.968965 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.969184 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.969268 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.969492 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.969583 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.969802 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.969896 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.970119 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.970210 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.970418 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.970505 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.970727 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.970813 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.971136 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.971229 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.971471 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.971689 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.971797 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.972045 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.972136 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.972362 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.972457 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.972670 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.972767 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.972971 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.973057 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.973286 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.973371 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.973586 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.973686 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.973893 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.973985 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.974198 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.974284 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.974501 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.974586 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.974800 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.974892 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.975099 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.975183 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.975414 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.975500 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.975716 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.975801 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.976061 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.976150 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.976373 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.976461 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.976687 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.976770 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.976986 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.977072 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.977284 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.977371 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.977598 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.977682 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.977893 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.977985 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.978193 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.978277 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.978493 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.978577 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.978789 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.978883 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.979085 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.979177 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.979381 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.979474 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.979693 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.979790 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.980011 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.980147 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.980332 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.980418 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.980639 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.980735 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.980953 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.981046 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.981269 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.981354 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.981568 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.981655 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.981884 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.981989 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.982189 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.982275 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.982491 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.982584 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.982789 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.982875 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.983087 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.983171 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.983393 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.983480 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.983695 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.983780 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.984022 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.984189 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.984326 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.984514 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.984630 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.984837 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.984922 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.985143 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.985229 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.985470 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.985555 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.985791 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.985875 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.986099 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.986232 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.986402 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.987001 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.987238 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.987429 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.987562 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.987830 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.987923 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.988154 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.988241 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.988471 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.988574 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.988781 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.988876 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.989084 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.989176 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.989387 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.989474 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.989690 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.989774 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.989995 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.990080 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.990296 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.990386 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.990596 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.990682 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.990897 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.990991 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.991208 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.991293 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.991506 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.991590 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.991820 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.992016 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.992151 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.992239 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.992451 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.992535 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.992760 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.992853 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.993056 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.993140 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.993394 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.993575 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.993692 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.993900 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.994018 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.994212 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.994325 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.994521 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.994643 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.994829 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.994956 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.995142 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.995266 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.995453 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.995574 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.995762 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.995884 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.996094 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.996220 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.996405 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.996546 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.996713 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.996826 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.997037 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.997122 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.997356 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.997455 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.997675 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.997763 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.998007 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.998092 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.998319 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.998520 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.998632 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.998844 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.998938 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.999155 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.999249 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.999463 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.999583 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.999769 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:25.999895 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.000104 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.000237 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.000418 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.000534 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.000724 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.000844 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.001031 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.001155 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.001335 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.001462 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.001639 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.001769 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.001958 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.002084 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.002355 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.002485 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.002726 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.002944 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.003040 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.003319 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.003405 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.003627 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.003712 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.003971 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.004062 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.004279 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.004374 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.004593 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.004679 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.004900 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.004985 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.005211 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.005297 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.005524 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.005609 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.005834 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.006041 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.006146 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.006359 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.006444 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.006690 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.006777 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.007011 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.007111 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.007330 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.007416 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.007636 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.007734 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.007957 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.008047 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.008269 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.008367 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.008576 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.008663 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.008876 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.008962 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.009433 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.009579 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.009744 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.009831 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.010045 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.010132 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.010359 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.010489 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.010664 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.010748 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.010964 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.011049 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.011280 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.011479 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.011587 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.011792 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.012148 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.012237 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.012473 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.012575 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.012792 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.012882 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.013101 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.013185 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.013412 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.013499 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.013724 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.013816 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.014024 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.014108 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.014324 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.014418 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.014631 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.014716 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.014931 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.015015 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.015228 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.015314 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.015537 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.015630 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.015838 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.015930 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.016160 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.016245 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.016467 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.016550 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.016769 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.016862 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.017069 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.017293 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.017377 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.017630 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.017723 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.018486 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.018567 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.018865 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.019048 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.019283 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.019369 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.019593 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.019680 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.019905 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.020141 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.020237 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.020325 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.020528 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.020623 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.020832 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.020926 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.021135 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.021229 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.021448 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.021540 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.021748 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.021833 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.022049 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.022144 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.022349 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.022528 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.022658 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.022842 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.023001 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.023148 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.023308 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.023452 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.023610 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.023751 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.023930 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.024098 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.024256 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.024402 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.024556 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.024702 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.024871 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.025002 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.025177 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.025308 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.025495 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.025607 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.025805 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.025891 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.026112 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.026197 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.026453 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.026580 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.026767 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.026853 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.027063 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.027294 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.027381 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.027623 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.027718 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.027970 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.028060 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.028298 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.028384 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.028601 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.028686 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.028898 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.028984 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.029204 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.029288 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.029500 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.029586 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.029797 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.029889 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.030106 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.030204 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.030411 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.030505 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.030714 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.030805 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.031017 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.031110 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.031322 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.031414 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.031629 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.031714 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.031955 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.032057 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.032262 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.032507 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.032597 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.032838 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.032924 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.033155 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.033242 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.033518 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.033609 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.034063 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.034201 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.034483 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.034609 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.034809 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.034898 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.035153 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.035248 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.035474 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.035559 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.035782 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.035874 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.036123 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.036287 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.036429 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.036522 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.036736 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.036827 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.037040 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.037133 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.037344 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.037436 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.037646 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.037738 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.037951 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.038037 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.038255 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.038342 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.038559 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.038645 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.038861 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.038946 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.039163 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.039465 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.039548 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.039768 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.039862 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.040110 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.040199 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.040451 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.040547 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.040766 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.040852 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.041074 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.041158 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.041385 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.041469 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.041694 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.041780 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.041994 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.042086 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.042295 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.042380 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.042599 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.042685 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.042902 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.042987 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.043214 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.043299 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.043539 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.043627 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.043845 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.043930 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.044169 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.044270 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.044471 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.044778 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.044862 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.045093 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.045191 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.045402 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.045496 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.045703 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.045795 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.046003 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.046096 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.046309 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.046395 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.046608 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.046695 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.046914 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.047008 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.047215 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.047301 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.047517 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.047603 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.047820 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.047914 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.048146 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.048236 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.048447 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.048534 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.048748 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.048846 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.049564 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.049852 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.049982 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.050154 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.050295 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.050459 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.050607 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.050760 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.050916 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.051062 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.051233 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.051360 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.051541 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.051662 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.051841 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.051980 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.052168 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.052312 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.052474 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.052643 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.052775 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.052957 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.053097 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.053276 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.053370 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.053584 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.053669 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.053903 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.053990 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.054209 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.054296 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.054506 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.054590 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.054851 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.054945 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.055102 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.055189 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.055397 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.055494 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.055694 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.055781 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.056019 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.056109 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.056319 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.056406 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.056618 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.056706 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.056926 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.057028 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.057211 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.057305 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.057505 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.057599 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.057828 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.057914 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.058150 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.058243 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.058453 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.058538 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.058767 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.058851 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.059072 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.059165 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.059385 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.059471 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.059686 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.059770 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.060012 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.060102 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.060328 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.060421 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.060632 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.060717 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.060933 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.061026 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.061236 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.061321 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.061540 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.061625 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.061839 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.061926 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.062144 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.062230 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.062445 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.062529 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.062745 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.062830 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.063049 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.063135 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.063356 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.063449 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.063680 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.063766 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.063996 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.064085 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.064315 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.064417 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.064675 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.064764 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.065006 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.065221 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.065540 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.065701 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.065860 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.065946 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.066206 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.066292 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.066509 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.066594 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.066815 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.066899 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.067118 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.067203 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.067422 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.067508 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.067667 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105431) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 16 01:45:26.067760 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.068044 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.068349 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.068652 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.068961 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.069269 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.069590 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.069908 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.070212 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.070529 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.070848 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.071189 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.071499 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.071838 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.072190 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.072500 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.072805 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.073102 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:45:26.073341 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=105432) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 16 01:45:26.221745 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: INFO dbcounter [None req-646e2472-0d3d-4d21-982d-dd5b6d99dbee None None] Registered counter for database nova_api Sep 16 01:45:26.230101 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: INFO dbcounter [None req-d3c4d3c9-a705-478e-b46f-b66daf2e4553 None None] Registered counter for database nova_api Sep 16 01:45:26.242123 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG oslo_db.sqlalchemy.engines [None req-646e2472-0d3d-4d21-982d-dd5b6d99dbee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105431) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 01:45:26.248792 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG dbcounter [-] [105431] Writer thread running {{(pid=105431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 01:45:26.249730 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG oslo_db.sqlalchemy.engines [None req-d3c4d3c9-a705-478e-b46f-b66daf2e4553 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105432) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 01:45:26.256897 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG dbcounter [-] [105432] Writer thread running {{(pid=105432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 01:45:26.305935 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.context [None req-646e2472-0d3d-4d21-982d-dd5b6d99dbee None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c617f603-de26-4777-9f52-27e34617b162(cell1) {{(pid=105431) load_cells /opt/stack/nova/nova/context.py:464}} Sep 16 01:45:26.309756 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG oslo_concurrency.lockutils [None req-646e2472-0d3d-4d21-982d-dd5b6d99dbee None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:45:26.310228 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG oslo_concurrency.lockutils [None req-646e2472-0d3d-4d21-982d-dd5b6d99dbee None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:45:26.311763 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG oslo_concurrency.lockutils [None req-646e2472-0d3d-4d21-982d-dd5b6d99dbee None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:45:26.312523 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG oslo_concurrency.lockutils [None req-646e2472-0d3d-4d21-982d-dd5b6d99dbee None None] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:45:26.312969 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG oslo_concurrency.lockutils [None req-646e2472-0d3d-4d21-982d-dd5b6d99dbee None None] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:45:26.314278 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.context [None req-d3c4d3c9-a705-478e-b46f-b66daf2e4553 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c617f603-de26-4777-9f52-27e34617b162(cell1) {{(pid=105432) load_cells /opt/stack/nova/nova/context.py:464}} Sep 16 01:45:26.315469 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG oslo_concurrency.lockutils [None req-646e2472-0d3d-4d21-982d-dd5b6d99dbee None None] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:45:26.317469 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: INFO dbcounter [None req-646e2472-0d3d-4d21-982d-dd5b6d99dbee None None] Registered counter for database nova_cell0 Sep 16 01:45:26.319270 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG oslo_concurrency.lockutils [None req-d3c4d3c9-a705-478e-b46f-b66daf2e4553 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:45:26.319745 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG oslo_concurrency.lockutils [None req-d3c4d3c9-a705-478e-b46f-b66daf2e4553 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:45:26.321311 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG oslo_concurrency.lockutils [None req-d3c4d3c9-a705-478e-b46f-b66daf2e4553 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:45:26.321532 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: INFO dbcounter [None req-646e2472-0d3d-4d21-982d-dd5b6d99dbee None None] Registered counter for database nova_cell1 Sep 16 01:45:26.322023 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG oslo_concurrency.lockutils [None req-d3c4d3c9-a705-478e-b46f-b66daf2e4553 None None] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:45:26.322586 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG oslo_concurrency.lockutils [None req-d3c4d3c9-a705-478e-b46f-b66daf2e4553 None None] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:45:26.324442 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG oslo_concurrency.lockutils [None req-d3c4d3c9-a705-478e-b46f-b66daf2e4553 None None] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=105432) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:45:26.326416 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: INFO dbcounter [None req-d3c4d3c9-a705-478e-b46f-b66daf2e4553 None None] Registered counter for database nova_cell0 Sep 16 01:45:26.328404 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG oslo_db.sqlalchemy.engines [None req-646e2472-0d3d-4d21-982d-dd5b6d99dbee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105431) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 01:45:26.331228 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG oslo_db.sqlalchemy.engines [None req-646e2472-0d3d-4d21-982d-dd5b6d99dbee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105431) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 01:45:26.331419 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: INFO dbcounter [None req-d3c4d3c9-a705-478e-b46f-b66daf2e4553 None None] Registered counter for database nova_cell1 Sep 16 01:45:26.336358 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG dbcounter [-] [105431] Writer thread running {{(pid=105431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 01:45:26.338849 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG oslo_db.sqlalchemy.engines [None req-d3c4d3c9-a705-478e-b46f-b66daf2e4553 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105432) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 01:45:26.339009 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG dbcounter [-] [105431] Writer thread running {{(pid=105431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 01:45:26.342567 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG oslo_db.sqlalchemy.engines [None req-d3c4d3c9-a705-478e-b46f-b66daf2e4553 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105432) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 01:45:26.344345 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG dbcounter [-] [105432] Writer thread running {{(pid=105432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 01:45:26.485301 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: INFO dbcounter [None req-646e2472-0d3d-4d21-982d-dd5b6d99dbee None None] Registered counter for database nova_cell0 Sep 16 01:45:26.486486 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG dbcounter [-] [105432] Writer thread running {{(pid=105432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 01:45:26.492874 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG oslo_db.sqlalchemy.engines [None req-646e2472-0d3d-4d21-982d-dd5b6d99dbee None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105431) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 01:45:26.496731 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: INFO dbcounter [None req-d3c4d3c9-a705-478e-b46f-b66daf2e4553 None None] Registered counter for database nova_cell0 Sep 16 01:45:26.497518 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG dbcounter [-] [105431] Writer thread running {{(pid=105431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 01:45:26.503704 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG oslo_db.sqlalchemy.engines [None req-d3c4d3c9-a705-478e-b46f-b66daf2e4553 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=105432) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 01:45:26.508363 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG dbcounter [-] [105432] Writer thread running {{(pid=105432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 01:45:26.837976 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: WARNING keystonemiddleware.auth_token [None req-646e2472-0d3d-4d21-982d-dd5b6d99dbee None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 16 01:45:26.841854 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: WARNING keystonemiddleware.auth_token [None req-d3c4d3c9-a705-478e-b46f-b66daf2e4553 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 16 01:45:26.845285 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: WARNING keystonemiddleware.auth_token [None req-646e2472-0d3d-4d21-982d-dd5b6d99dbee None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 16 01:45:26.849965 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: WARNING keystonemiddleware.auth_token [None req-d3c4d3c9-a705-478e-b46f-b66daf2e4553 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 16 01:45:27.188650 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: WARNING keystonemiddleware.auth_token [None req-646e2472-0d3d-4d21-982d-dd5b6d99dbee None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 16 01:45:27.194639 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: WARNING keystonemiddleware.auth_token [None req-646e2472-0d3d-4d21-982d-dd5b6d99dbee None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 16 01:45:27.195537 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: WARNING keystonemiddleware.auth_token [None req-d3c4d3c9-a705-478e-b46f-b66daf2e4553 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 16 01:45:27.200186 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561493bb79c0 pid: 105431 (default app) Sep 16 01:45:27.201470 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: WARNING keystonemiddleware.auth_token [None req-d3c4d3c9-a705-478e-b46f-b66daf2e4553 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 16 01:45:27.202248 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi [None req-646e2472-0d3d-4d21-982d-dd5b6d99dbee None None] Calling method '>' {{(pid=105431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:45:27.203419 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: INFO nova.api.openstack.requestlog [None req-646e2472-0d3d-4d21-982d-dd5b6d99dbee None None] 10.222.0.42 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001711 Sep 16 01:45:27.203832 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: [pid: 105431|app: 0|req: 1/1] 10.222.0.42 () {50 vars in 788 bytes} [Fri Sep 16 01:45:27 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:45:27.207179 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561493bb79c0 pid: 105432 (default app) Sep 16 01:46:49.279033 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi [None req-646e2472-0d3d-4d21-982d-dd5b6d99dbee None None] Calling method '>' {{(pid=105431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:46:49.281465 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: INFO nova.api.openstack.requestlog [None req-646e2472-0d3d-4d21-982d-dd5b6d99dbee None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002863 Sep 16 01:46:49.282926 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: [pid: 105431|app: 0|req: 2/2] 10.222.0.42 () {54 vars in 931 bytes} [Fri Sep 16 01:46:49 2022] GET /compute/v2.1 => generated 388 bytes in 5 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:46:49.294021 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG dbcounter [-] [105432] Writing DB stats nova_api:SELECT=3 {{(pid=105432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:46:49.294959 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG dbcounter [-] [105432] Writing DB stats nova_cell0:SELECT=3 {{(pid=105432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:46:49.296755 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG dbcounter [-] [105432] Writing DB stats nova_cell1:SELECT=3 {{(pid=105432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:46:49.298709 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG dbcounter [-] [105432] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:46:50.195410 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi [None req-61d95549-f43b-4a8f-a9ac-813cb82551ce admin admin] Calling method '>' {{(pid=105432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:46:50.227952 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: INFO nova.api.openstack.requestlog [None req-61d95549-f43b-4a8f-a9ac-813cb82551ce admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.938946 Sep 16 01:46:50.232016 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: [pid: 105432|app: 0|req: 1/3] 10.222.0.42 () {60 vars in 1292 bytes} [Fri Sep 16 01:46:49 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 941 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:46:52.921352 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi [None req-646e2472-0d3d-4d21-982d-dd5b6d99dbee None None] Calling method '>' {{(pid=105431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:46:52.922348 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: INFO nova.api.openstack.requestlog [None req-646e2472-0d3d-4d21-982d-dd5b6d99dbee None None] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001472 Sep 16 01:46:52.927907 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: [pid: 105431|app: 0|req: 3/4] 10.222.0.42 () {54 vars in 931 bytes} [Fri Sep 16 01:46:52 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:46:53.402345 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi [None req-7aeadf61-ffbe-4718-8765-b517e55047a7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 1, "os-flavor-access:is_public": true, "id": "c1", "rxtx_factor": 1.0, "name": "cirros256", "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1, "swap": 0, "ram": 256}} {{(pid=105432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:46:53.451079 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: INFO nova.api.openstack.requestlog [None req-7aeadf61-ffbe-4718-8765-b517e55047a7 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.521692 Sep 16 01:46:53.452024 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: [pid: 105432|app: 0|req: 2/5] 10.222.0.42 () {64 vars in 1283 bytes} [Fri Sep 16 01:46:52 2022] POST /compute/v2.1/flavors => generated 407 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 01:46:53.465863 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG dbcounter [-] [105431] Writing DB stats nova_api:SELECT=3 {{(pid=105431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:46:53.466676 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG dbcounter [-] [105431] Writing DB stats nova_cell1:SELECT=3 {{(pid=105431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:46:53.468678 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG dbcounter [-] [105431] Writing DB stats nova_cell0:SELECT=3 {{(pid=105431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:46:53.469745 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG dbcounter [-] [105431] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=105431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:46:53.677478 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi [None req-2e84c18d-fb5d-43cc-a8f2-80da60983ca6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:46:53.747793 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: INFO nova.api.openstack.requestlog [None req-2e84c18d-fb5d-43cc-a8f2-80da60983ca6 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.287051 Sep 16 01:46:53.752019 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: [pid: 105431|app: 0|req: 4/6] 10.222.0.42 () {64 vars in 1336 bytes} [Fri Sep 16 01:46:53 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:46:56.397398 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi [None req-7aeadf61-ffbe-4718-8765-b517e55047a7 admin admin] Calling method '>' {{(pid=105432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:46:56.398327 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: INFO nova.api.openstack.requestlog [None req-7aeadf61-ffbe-4718-8765-b517e55047a7 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Sep 16 01:46:56.398721 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: [pid: 105432|app: 0|req: 3/7] 10.222.0.42 () {54 vars in 931 bytes} [Fri Sep 16 01:46:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 01:46:57.072368 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi [None req-9d352fb4-f523-4db1-915d-79ef9e79f21a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "id": "d1", "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds512M", "rxtx_factor": 1.0, "disk": 5, "vcpus": 1, "os-flavor-access:is_public": true, "ram": 512}} {{(pid=105431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:46:57.118658 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: INFO nova.api.openstack.requestlog [None req-9d352fb4-f523-4db1-915d-79ef9e79f21a admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.713401 Sep 16 01:46:57.119588 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: [pid: 105431|app: 0|req: 5/8] 10.222.0.42 () {64 vars in 1283 bytes} [Fri Sep 16 01:46:56 2022] POST /compute/v2.1/flavors => generated 404 bytes in 715 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 01:46:57.132230 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi [None req-6e786679-f882-4216-8965-4baf89d37400 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:46:57.175695 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: INFO nova.api.openstack.requestlog [None req-6e786679-f882-4216-8965-4baf89d37400 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.047017 Sep 16 01:46:57.176341 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: [pid: 105432|app: 0|req: 4/9] 10.222.0.42 () {64 vars in 1336 bytes} [Fri Sep 16 01:46:57 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:46:59.816478 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi [None req-9d352fb4-f523-4db1-915d-79ef9e79f21a admin admin] Calling method '>' {{(pid=105431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:46:59.817499 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: INFO nova.api.openstack.requestlog [None req-9d352fb4-f523-4db1-915d-79ef9e79f21a admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001530 Sep 16 01:46:59.817902 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: [pid: 105431|app: 0|req: 6/10] 10.222.0.42 () {54 vars in 931 bytes} [Fri Sep 16 01:46:59 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:47:00.244707 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi [None req-3091b7b5-a5f8-4844-91a1-3d550094993f admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 1024, "id": "d2", "disk": 10, "os-flavor-access:is_public": true, "name": "ds1G", "swap": 0}} {{(pid=105432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:47:00.266194 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: INFO nova.api.openstack.requestlog [None req-3091b7b5-a5f8-4844-91a1-3d550094993f admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.441350 Sep 16 01:47:00.266839 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: [pid: 105432|app: 0|req: 5/11] 10.222.0.42 () {64 vars in 1283 bytes} [Fri Sep 16 01:46:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 443 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 01:47:00.278617 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi [None req-96d00af7-c1a9-4d11-b6bd-9ac3abd36149 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:47:00.307303 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: INFO nova.api.openstack.requestlog [None req-96d00af7-c1a9-4d11-b6bd-9ac3abd36149 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.032311 Sep 16 01:47:00.308209 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: [pid: 105431|app: 0|req: 7/12] 10.222.0.42 () {64 vars in 1336 bytes} [Fri Sep 16 01:47:00 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:47:02.928281 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi [None req-3091b7b5-a5f8-4844-91a1-3d550094993f admin admin] Calling method '>' {{(pid=105432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:47:02.929303 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: INFO nova.api.openstack.requestlog [None req-3091b7b5-a5f8-4844-91a1-3d550094993f admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001487 Sep 16 01:47:02.929715 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: [pid: 105432|app: 0|req: 6/13] 10.222.0.42 () {54 vars in 931 bytes} [Fri Sep 16 01:47:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:47:03.352457 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi [None req-eaa66643-079c-4f19-b526-6abb13584efb admin admin] Action: 'create', calling method: >, body: {"flavor": {"ram": 2048, "name": "ds2G", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "d3", "disk": 10, "swap": 0, "vcpus": 2}} {{(pid=105431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:47:03.372828 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: INFO nova.api.openstack.requestlog [None req-eaa66643-079c-4f19-b526-6abb13584efb admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.436647 Sep 16 01:47:03.373808 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: [pid: 105431|app: 0|req: 8/14] 10.222.0.42 () {64 vars in 1283 bytes} [Fri Sep 16 01:47:02 2022] POST /compute/v2.1/flavors => generated 404 bytes in 438 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 01:47:03.385965 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi [None req-610054d9-1b5e-456f-bb60-65d258c226d8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:47:03.413581 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: INFO nova.api.openstack.requestlog [None req-610054d9-1b5e-456f-bb60-65d258c226d8 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031429 Sep 16 01:47:03.414450 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: [pid: 105432|app: 0|req: 7/15] 10.222.0.42 () {64 vars in 1336 bytes} [Fri Sep 16 01:47:03 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 01:47:06.116021 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi [None req-eaa66643-079c-4f19-b526-6abb13584efb admin admin] Calling method '>' {{(pid=105431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:47:06.117145 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: INFO nova.api.openstack.requestlog [None req-eaa66643-079c-4f19-b526-6abb13584efb admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001606 Sep 16 01:47:06.117654 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: [pid: 105431|app: 0|req: 9/16] 10.222.0.42 () {54 vars in 931 bytes} [Fri Sep 16 01:47:06 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 01:47:06.619242 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi [None req-f82d34fa-74cd-4091-a786-774c602aedb5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "ram": 4096, "os-flavor-access:is_public": true, "name": "ds4G", "vcpus": 4, "swap": 0, "disk": 20, "id": "d4"}} {{(pid=105432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:47:06.645605 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: INFO nova.api.openstack.requestlog [None req-f82d34fa-74cd-4091-a786-774c602aedb5 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.519189 Sep 16 01:47:06.646433 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: [pid: 105432|app: 0|req: 8/17] 10.222.0.42 () {64 vars in 1283 bytes} [Fri Sep 16 01:47:06 2022] POST /compute/v2.1/flavors => generated 404 bytes in 521 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 01:47:06.663637 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi [None req-53eb37ce-9844-4874-bd4a-d469141824fc admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:47:06.698109 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: INFO nova.api.openstack.requestlog [None req-53eb37ce-9844-4874-bd4a-d469141824fc admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039521 Sep 16 01:47:06.699130 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: [pid: 105431|app: 0|req: 10/18] 10.222.0.42 () {64 vars in 1336 bytes} [Fri Sep 16 01:47:06 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:47:09.364514 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi [None req-f82d34fa-74cd-4091-a786-774c602aedb5 admin admin] Calling method '>' {{(pid=105432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:47:09.365526 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: INFO nova.api.openstack.requestlog [None req-f82d34fa-74cd-4091-a786-774c602aedb5 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001508 Sep 16 01:47:09.365953 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: [pid: 105432|app: 0|req: 9/19] 10.222.0.42 () {54 vars in 931 bytes} [Fri Sep 16 01:47:09 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:47:09.844493 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi [None req-44e21b61-041f-46f6-af54-11b6a326536c admin admin] Calling method '>' {{(pid=105431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:47:09.869541 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: INFO nova.api.openstack.requestlog [None req-44e21b61-041f-46f6-af54-11b6a326536c admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.497561 Sep 16 01:47:09.870080 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: [pid: 105431|app: 0|req: 11/20] 10.222.0.42 () {60 vars in 1292 bytes} [Fri Sep 16 01:47:09 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 499 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 01:47:12.677481 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi [None req-f82d34fa-74cd-4091-a786-774c602aedb5 admin admin] Calling method '>' {{(pid=105432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:47:12.678496 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: INFO nova.api.openstack.requestlog [None req-f82d34fa-74cd-4091-a786-774c602aedb5 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001457 Sep 16 01:47:12.678899 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: [pid: 105432|app: 0|req: 10/21] 10.222.0.42 () {54 vars in 931 bytes} [Fri Sep 16 01:47:12 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:47:13.072919 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi [None req-6399904a-0a5d-43e9-95b0-0f14fcf9764f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 512, "swap": 0, "vcpus": 1, "id": "1", "disk": 1, "os-flavor-access:is_public": true}} {{(pid=105431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:47:13.094356 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: INFO nova.api.openstack.requestlog [None req-6399904a-0a5d-43e9-95b0-0f14fcf9764f admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.409377 Sep 16 01:47:13.094893 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: [pid: 105431|app: 0|req: 12/22] 10.222.0.42 () {64 vars in 1283 bytes} [Fri Sep 16 01:47:12 2022] POST /compute/v2.1/flavors => generated 402 bytes in 411 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 16 01:47:13.107241 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi [None req-34be15b1-6221-4e83-bf69-867f59ef5da8 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:47:13.135302 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: INFO nova.api.openstack.requestlog [None req-34be15b1-6221-4e83-bf69-867f59ef5da8 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.031670 Sep 16 01:47:13.135882 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: [pid: 105432|app: 0|req: 11/23] 10.222.0.42 () {64 vars in 1333 bytes} [Fri Sep 16 01:47:13 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:47:15.785109 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi [None req-6399904a-0a5d-43e9-95b0-0f14fcf9764f admin admin] Calling method '>' {{(pid=105431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:47:15.786025 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: INFO nova.api.openstack.requestlog [None req-6399904a-0a5d-43e9-95b0-0f14fcf9764f admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001409 Sep 16 01:47:15.786419 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: [pid: 105431|app: 0|req: 13/24] 10.222.0.42 () {54 vars in 931 bytes} [Fri Sep 16 01:47:15 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:47:16.145186 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi [None req-408a3788-5b45-4f72-b697-2a5e6ef1d2a1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "2", "os-flavor-access:is_public": true, "name": "m1.small", "swap": 0, "disk": 20, "ram": 2048, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 1}} {{(pid=105432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:47:16.165511 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: INFO nova.api.openstack.requestlog [None req-408a3788-5b45-4f72-b697-2a5e6ef1d2a1 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.373084 Sep 16 01:47:16.166082 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: [pid: 105432|app: 0|req: 12/25] 10.222.0.42 () {64 vars in 1283 bytes} [Fri Sep 16 01:47:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 16 01:47:16.179183 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi [None req-46d405ba-1ca9-4df7-a515-c29d491290de admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:47:16.204215 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: INFO nova.api.openstack.requestlog [None req-46d405ba-1ca9-4df7-a515-c29d491290de admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.028556 Sep 16 01:47:16.205017 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: [pid: 105431|app: 0|req: 14/26] 10.222.0.42 () {64 vars in 1333 bytes} [Fri Sep 16 01:47:16 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:47:18.891446 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi [None req-408a3788-5b45-4f72-b697-2a5e6ef1d2a1 admin admin] Calling method '>' {{(pid=105432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:47:18.893134 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: INFO nova.api.openstack.requestlog [None req-408a3788-5b45-4f72-b697-2a5e6ef1d2a1 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002119 Sep 16 01:47:18.893694 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: [pid: 105432|app: 0|req: 13/27] 10.222.0.42 () {54 vars in 931 bytes} [Fri Sep 16 01:47:18 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:47:19.350950 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi [None req-8f336acb-8a3c-4f74-a614-396bba5b0c22 admin admin] Action: 'create', calling method: >, body: {"flavor": {"OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.medium", "os-flavor-access:is_public": true, "id": "3", "disk": 40, "rxtx_factor": 1.0, "ram": 4096, "swap": 0, "vcpus": 2}} {{(pid=105431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:47:19.371848 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: INFO nova.api.openstack.requestlog [None req-8f336acb-8a3c-4f74-a614-396bba5b0c22 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.471782 Sep 16 01:47:19.373046 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: [pid: 105431|app: 0|req: 15/28] 10.222.0.42 () {64 vars in 1283 bytes} [Fri Sep 16 01:47:18 2022] POST /compute/v2.1/flavors => generated 406 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 16 01:47:19.385712 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi [None req-d53054a8-602d-4930-a8e6-1c8e5fe6a365 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:47:19.391492 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG dbcounter [-] [105432] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=105432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:47:19.421113 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: INFO nova.api.openstack.requestlog [None req-d53054a8-602d-4930-a8e6-1c8e5fe6a365 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.039654 Sep 16 01:47:19.424366 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: [pid: 105432|app: 0|req: 14/29] 10.222.0.42 () {64 vars in 1333 bytes} [Fri Sep 16 01:47:19 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 01:47:22.095979 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi [None req-8f336acb-8a3c-4f74-a614-396bba5b0c22 admin admin] Calling method '>' {{(pid=105431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:47:22.096923 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: INFO nova.api.openstack.requestlog [None req-8f336acb-8a3c-4f74-a614-396bba5b0c22 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001521 Sep 16 01:47:22.097323 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: [pid: 105431|app: 0|req: 16/30] 10.222.0.42 () {54 vars in 931 bytes} [Fri Sep 16 01:47:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:47:22.557433 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi [None req-10e4043c-8fba-4216-b6e3-88b62df1aae1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 4, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "m1.large", "swap": 0, "ram": 8192, "disk": 80, "id": "4"}} {{(pid=105432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:47:22.577156 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: INFO nova.api.openstack.requestlog [None req-10e4043c-8fba-4216-b6e3-88b62df1aae1 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.473549 Sep 16 01:47:22.580016 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: [pid: 105432|app: 0|req: 15/31] 10.222.0.42 () {64 vars in 1283 bytes} [Fri Sep 16 01:47:22 2022] POST /compute/v2.1/flavors => generated 405 bytes in 475 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 16 01:47:22.590469 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi [None req-6875974b-e506-4000-8a47-8477dc306d81 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:47:22.628847 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: INFO nova.api.openstack.requestlog [None req-6875974b-e506-4000-8a47-8477dc306d81 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.042686 Sep 16 01:47:22.630584 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: [pid: 105431|app: 0|req: 17/32] 10.222.0.42 () {64 vars in 1333 bytes} [Fri Sep 16 01:47:22 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 01:47:25.319653 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi [None req-10e4043c-8fba-4216-b6e3-88b62df1aae1 admin admin] Calling method '>' {{(pid=105432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:47:25.320691 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: INFO nova.api.openstack.requestlog [None req-10e4043c-8fba-4216-b6e3-88b62df1aae1 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001466 Sep 16 01:47:25.327015 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: [pid: 105432|app: 0|req: 16/33] 10.222.0.42 () {54 vars in 931 bytes} [Fri Sep 16 01:47:25 2022] GET /compute/v2.1 => generated 388 bytes in 8 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:47:25.773394 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi [None req-9d379491-0f0a-44c5-b04b-dd384d55875d admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 8, "name": "m1.xlarge", "disk": 160, "ram": 16384, "id": "5", "os-flavor-access:is_public": true}} {{(pid=105431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:47:25.781427 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG dbcounter [-] [105431] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=105431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:47:25.804073 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: INFO nova.api.openstack.requestlog [None req-9d379491-0f0a-44c5-b04b-dd384d55875d admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.476008 Sep 16 01:47:25.807977 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: [pid: 105431|app: 0|req: 18/34] 10.222.0.42 () {64 vars in 1283 bytes} [Fri Sep 16 01:47:25 2022] POST /compute/v2.1/flavors => generated 408 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 01:47:25.820549 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi [None req-fd2cf7a8-45b5-418f-a81a-53ac48c75094 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=105432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:47:25.845929 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: INFO nova.api.openstack.requestlog [None req-fd2cf7a8-45b5-418f-a81a-53ac48c75094 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.029031 Sep 16 01:47:25.846823 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: [pid: 105432|app: 0|req: 17/35] 10.222.0.42 () {64 vars in 1333 bytes} [Fri Sep 16 01:47:25 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 01:47:42.597809 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi [None req-9d379491-0f0a-44c5-b04b-dd384d55875d admin admin] Calling method '>' {{(pid=105431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:47:42.598790 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: INFO nova.api.openstack.requestlog [None req-9d379491-0f0a-44c5-b04b-dd384d55875d admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Sep 16 01:47:42.599191 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: [pid: 105431|app: 0|req: 19/36] 10.222.0.42 () {54 vars in 931 bytes} [Fri Sep 16 01:47:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:47:42.606857 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG dbcounter [-] [105432] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=105432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:47:42.994150 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi [None req-a8b78f42-aacb-45a0-8492-67035a413cf6 admin admin] Calling method '>' {{(pid=105432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:47:43.013025 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: INFO nova.api.openstack.requestlog [None req-a8b78f42-aacb-45a0-8492-67035a413cf6 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.407713 Sep 16 01:47:43.013553 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: [pid: 105432|app: 0|req: 18/37] 10.222.0.42 () {60 vars in 1292 bytes} [Fri Sep 16 01:47:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:47:44.317381 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi [None req-9d379491-0f0a-44c5-b04b-dd384d55875d admin admin] Calling method '>' {{(pid=105431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:47:44.318387 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: INFO nova.api.openstack.requestlog [None req-9d379491-0f0a-44c5-b04b-dd384d55875d admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001422 Sep 16 01:47:44.318800 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: [pid: 105431|app: 0|req: 20/38] 10.222.0.42 () {56 vars in 1074 bytes} [Fri Sep 16 01:47:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:47:44.844748 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi [None req-cef3ef51-f75f-4957-b68e-1e09d63b7791 admin admin] Calling method '>' {{(pid=105432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:47:44.850072 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: INFO nova.api.openstack.wsgi [None req-cef3ef51-f75f-4957-b68e-1e09d63b7791 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 16 01:47:44.853324 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi [None req-cef3ef51-f75f-4957-b68e-1e09d63b7791 admin admin] Request method failure captured: Sep 16 01:47:44.853324 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 16 01:47:44.853324 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: Accept: application/json Sep 16 01:47:44.853324 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: Accept-Encoding: gzip, deflate Sep 16 01:47:44.853324 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: Connection: keep-alive Sep 16 01:47:44.853324 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: Content-Length: 0 Sep 16 01:47:44.853324 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: Host: 10.222.0.42 Sep 16 01:47:44.853324 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: Openstack-Api-Version: compute 2.92 Sep 16 01:47:44.853324 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: Openstack-System-Scope: None Sep 16 01:47:44.853324 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: User-Agent: python-novaclient Sep 16 01:47:44.853324 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-Auth-Token: gAAAAABjI9XAlNdGfEBJoncTNvf4uU-iMNEC8MR0j21lfH2Ol4VNKH94vpWCbwVe_esAUrwDbxNmLi1Xp2i2YJOlq-UhQXBl_0oZgtCHC_CAqAE5qhgzanM1mDfHOYhru24SsTJ_N7Ui7ixuUff6A-ImaAknHMK6_QTjLQzt843ZU5h30eAOv_4 Sep 16 01:47:44.853324 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-Domain-Id: None Sep 16 01:47:44.853324 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-Domain-Name: None Sep 16 01:47:44.853324 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-Identity-Status: Confirmed Sep 16 01:47:44.853324 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-Is-Admin-Project: True Sep 16 01:47:44.853324 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-Openstack-Nova-Api-Version: 2.92 Sep 16 01:47:44.853324 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-Project-Domain-Id: default Sep 16 01:47:44.853324 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-Project-Domain-Name: Default Sep 16 01:47:44.853324 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-Project-Id: efec9f6da9c342038dd7466c677c23ad Sep 16 01:47:44.853324 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-Project-Name: admin Sep 16 01:47:44.853324 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-Role: member,admin,reader Sep 16 01:47:44.853324 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-Roles: member,admin,reader Sep 16 01:47:44.854904 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/efec9f6da9c342038dd7466c677c23ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/efec9f6da9c342038dd7466c677c23ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_efec9f6da9c342038dd7466c677c23ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/efec9f6da9c342038dd7466c677c23ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 01:47:44.854904 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-Tenant: admin Sep 16 01:47:44.854904 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-Tenant-Id: efec9f6da9c342038dd7466c677c23ad Sep 16 01:47:44.854904 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-Tenant-Name: admin Sep 16 01:47:44.854904 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-User: admin Sep 16 01:47:44.854904 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-User-Domain-Id: default Sep 16 01:47:44.854904 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-User-Domain-Name: Default Sep 16 01:47:44.854904 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-User-Id: a00246e1b29a4746b4e48d4dc1f5618c Sep 16 01:47:44.854904 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-User-Name: admin Sep 16 01:47:44.854904 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: method: > Sep 16 01:47:44.854904 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: exception: Flavor 42 could not be found. Sep 16 01:47:44.854904 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: action_args: {'id': '42'} Sep 16 01:47:44.854904 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: {{(pid=105432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 01:47:44.854904 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:47:44.856863 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 16 01:47:44.856863 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 16 01:47:44.856863 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 16 01:47:44.856863 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 16 01:47:44.856863 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 01:47:44.856863 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 01:47:44.856863 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 16 01:47:44.856863 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 16 01:47:44.856863 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 16 01:47:44.856863 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 01:47:44.856863 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 16 01:47:44.856863 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 16 01:47:44.856863 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 16 01:47:44.856863 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi Sep 16 01:47:44.856863 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:47:44.856863 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi Sep 16 01:47:44.856863 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:47:44.856863 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 01:47:44.856863 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 01:47:44.858226 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 01:47:44.858226 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 01:47:44.858226 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 01:47:44.858226 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 01:47:44.858226 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 16 01:47:44.858226 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 01:47:44.858226 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 16 01:47:44.858226 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi Sep 16 01:47:44.858226 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:47:44.858226 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi Sep 16 01:47:44.858226 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:47:44.858226 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 01:47:44.858226 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 01:47:44.858226 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 01:47:44.858226 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 01:47:44.858226 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 16 01:47:44.858226 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi Sep 16 01:47:44.858226 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi [None req-cef3ef51-f75f-4957-b68e-1e09d63b7791 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 01:47:44.859471 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: INFO nova.api.openstack.requestlog [None req-cef3ef51-f75f-4957-b68e-1e09d63b7791 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.397552 Sep 16 01:47:44.859471 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: [pid: 105432|app: 0|req: 19/39] 10.222.0.42 () {60 vars in 1190 bytes} [Fri Sep 16 01:47:44 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 399 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 16 01:47:44.865144 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi [None req-af88ec7c-bffe-47d5-bc68-fcb0be7384fe admin admin] Calling method '>' {{(pid=105431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:47:44.888522 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: INFO nova.api.openstack.requestlog [None req-af88ec7c-bffe-47d5-bc68-fcb0be7384fe admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026942 Sep 16 01:47:44.889066 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: [pid: 105431|app: 0|req: 21/40] 10.222.0.42 () {60 vars in 1210 bytes} [Fri Sep 16 01:47:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:47:44.899614 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi [None req-5ea15243-d227-43ba-9445-60ad7fea3902 admin admin] Calling method '>' {{(pid=105432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:47:44.921852 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: INFO nova.api.openstack.requestlog [None req-5ea15243-d227-43ba-9445-60ad7fea3902 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026677 Sep 16 01:47:44.922379 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: [pid: 105432|app: 0|req: 20/41] 10.222.0.42 () {60 vars in 1210 bytes} [Fri Sep 16 01:47:44 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:47:44.931645 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi [None req-8b41329e-fc40-44a2-a134-f0a1fbcd7ba6 admin admin] Calling method '>' {{(pid=105431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:47:44.937170 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: INFO nova.api.openstack.wsgi [None req-8b41329e-fc40-44a2-a134-f0a1fbcd7ba6 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 16 01:47:44.940435 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi [None req-8b41329e-fc40-44a2-a134-f0a1fbcd7ba6 admin admin] Request method failure captured: Sep 16 01:47:44.940435 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 16 01:47:44.940435 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: Accept: application/json Sep 16 01:47:44.940435 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: Accept-Encoding: gzip, deflate Sep 16 01:47:44.940435 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: Connection: keep-alive Sep 16 01:47:44.940435 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: Content-Length: 0 Sep 16 01:47:44.940435 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: Host: 10.222.0.42 Sep 16 01:47:44.940435 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: Openstack-Api-Version: compute 2.92 Sep 16 01:47:44.940435 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: Openstack-System-Scope: None Sep 16 01:47:44.940435 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: User-Agent: python-novaclient Sep 16 01:47:44.940435 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-Auth-Token: gAAAAABjI9XAlNdGfEBJoncTNvf4uU-iMNEC8MR0j21lfH2Ol4VNKH94vpWCbwVe_esAUrwDbxNmLi1Xp2i2YJOlq-UhQXBl_0oZgtCHC_CAqAE5qhgzanM1mDfHOYhru24SsTJ_N7Ui7ixuUff6A-ImaAknHMK6_QTjLQzt843ZU5h30eAOv_4 Sep 16 01:47:44.940435 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-Domain-Id: None Sep 16 01:47:44.940435 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-Domain-Name: None Sep 16 01:47:44.940435 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-Identity-Status: Confirmed Sep 16 01:47:44.940435 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-Is-Admin-Project: True Sep 16 01:47:44.940435 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-Openstack-Nova-Api-Version: 2.92 Sep 16 01:47:44.940435 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-Project-Domain-Id: default Sep 16 01:47:44.940435 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-Project-Domain-Name: Default Sep 16 01:47:44.940435 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-Project-Id: efec9f6da9c342038dd7466c677c23ad Sep 16 01:47:44.940435 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-Project-Name: admin Sep 16 01:47:44.940435 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-Role: member,admin,reader Sep 16 01:47:44.940435 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-Roles: member,admin,reader Sep 16 01:47:44.941922 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/efec9f6da9c342038dd7466c677c23ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/efec9f6da9c342038dd7466c677c23ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_efec9f6da9c342038dd7466c677c23ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/efec9f6da9c342038dd7466c677c23ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 01:47:44.941922 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-Tenant: admin Sep 16 01:47:44.941922 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-Tenant-Id: efec9f6da9c342038dd7466c677c23ad Sep 16 01:47:44.941922 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-Tenant-Name: admin Sep 16 01:47:44.941922 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-User: admin Sep 16 01:47:44.941922 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-User-Domain-Id: default Sep 16 01:47:44.941922 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-User-Domain-Name: Default Sep 16 01:47:44.941922 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-User-Id: a00246e1b29a4746b4e48d4dc1f5618c Sep 16 01:47:44.941922 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-User-Name: admin Sep 16 01:47:44.941922 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: method: > Sep 16 01:47:44.941922 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: exception: Flavor 42 could not be found. Sep 16 01:47:44.941922 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: action_args: {'id': '42'} Sep 16 01:47:44.941922 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: {{(pid=105431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 01:47:44.941922 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:47:44.942948 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 16 01:47:44.942948 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 16 01:47:44.942948 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 16 01:47:44.942948 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 16 01:47:44.942948 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 01:47:44.942948 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 01:47:44.942948 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 16 01:47:44.942948 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 16 01:47:44.942948 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 16 01:47:44.942948 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 01:47:44.942948 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 16 01:47:44.942948 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 16 01:47:44.942948 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 16 01:47:44.942948 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi Sep 16 01:47:44.942948 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:47:44.942948 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi Sep 16 01:47:44.942948 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:47:44.942948 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 01:47:44.942948 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 01:47:44.944356 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 01:47:44.944356 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 01:47:44.944356 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 01:47:44.944356 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 01:47:44.944356 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 16 01:47:44.944356 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 01:47:44.944356 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 16 01:47:44.944356 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi Sep 16 01:47:44.944356 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:47:44.944356 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi Sep 16 01:47:44.944356 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:47:44.944356 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 01:47:44.944356 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 01:47:44.944356 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 01:47:44.944356 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 01:47:44.944356 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 16 01:47:44.944356 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi Sep 16 01:47:44.944356 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi [None req-8b41329e-fc40-44a2-a134-f0a1fbcd7ba6 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=105431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 01:47:44.945580 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: INFO nova.api.openstack.requestlog [None req-8b41329e-fc40-44a2-a134-f0a1fbcd7ba6 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.013810 Sep 16 01:47:44.945580 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: [pid: 105431|app: 0|req: 22/42] 10.222.0.42 () {60 vars in 1190 bytes} [Fri Sep 16 01:47:44 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 16 01:47:46.167726 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi [None req-5ea15243-d227-43ba-9445-60ad7fea3902 admin admin] Calling method '>' {{(pid=105432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:47:46.168775 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: INFO nova.api.openstack.requestlog [None req-5ea15243-d227-43ba-9445-60ad7fea3902 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001490 Sep 16 01:47:46.169168 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: [pid: 105432|app: 0|req: 21/43] 10.222.0.42 () {56 vars in 1074 bytes} [Fri Sep 16 01:47:46 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:47:46.691083 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi [None req-820f157c-3730-46ef-8226-f676e17a6265 admin admin] Calling method '>' {{(pid=105431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:47:46.696131 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: INFO nova.api.openstack.wsgi [None req-820f157c-3730-46ef-8226-f676e17a6265 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 16 01:47:46.697639 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi [None req-820f157c-3730-46ef-8226-f676e17a6265 admin admin] Request method failure captured: Sep 16 01:47:46.697639 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 16 01:47:46.697639 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: Accept: application/json Sep 16 01:47:46.697639 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: Accept-Encoding: gzip, deflate Sep 16 01:47:46.697639 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: Connection: keep-alive Sep 16 01:47:46.697639 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: Content-Length: 0 Sep 16 01:47:46.697639 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: Host: 10.222.0.42 Sep 16 01:47:46.697639 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: Openstack-Api-Version: compute 2.92 Sep 16 01:47:46.697639 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: Openstack-System-Scope: None Sep 16 01:47:46.697639 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: User-Agent: python-novaclient Sep 16 01:47:46.697639 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-Auth-Token: gAAAAABjI9XCv4GUk1L3Xdgo4KkMotKj8rq_opIeqQBXms6lVU_OCNL8GPBQMHNygDbPSXI_2pQ_xLLJtQjmHqHuMJHSSJ7N2f0T2zqnHTvqJQrTwjngVdEJGcXDrVtxrJGsWcn-KsM7q3E1mR6eFFlUQzNY3xvwDuydL7AdLVzagCZG6QhE4JQ Sep 16 01:47:46.697639 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-Domain-Id: None Sep 16 01:47:46.697639 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-Domain-Name: None Sep 16 01:47:46.697639 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-Identity-Status: Confirmed Sep 16 01:47:46.697639 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-Is-Admin-Project: True Sep 16 01:47:46.697639 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-Openstack-Nova-Api-Version: 2.92 Sep 16 01:47:46.697639 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-Project-Domain-Id: default Sep 16 01:47:46.697639 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-Project-Domain-Name: Default Sep 16 01:47:46.697639 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-Project-Id: efec9f6da9c342038dd7466c677c23ad Sep 16 01:47:46.697639 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-Project-Name: admin Sep 16 01:47:46.697639 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-Role: member,admin,reader Sep 16 01:47:46.697639 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-Roles: member,admin,reader Sep 16 01:47:46.699666 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/efec9f6da9c342038dd7466c677c23ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/efec9f6da9c342038dd7466c677c23ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_efec9f6da9c342038dd7466c677c23ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/efec9f6da9c342038dd7466c677c23ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 01:47:46.699666 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-Tenant: admin Sep 16 01:47:46.699666 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-Tenant-Id: efec9f6da9c342038dd7466c677c23ad Sep 16 01:47:46.699666 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-Tenant-Name: admin Sep 16 01:47:46.699666 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-User: admin Sep 16 01:47:46.699666 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-User-Domain-Id: default Sep 16 01:47:46.699666 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-User-Domain-Name: Default Sep 16 01:47:46.699666 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-User-Id: a00246e1b29a4746b4e48d4dc1f5618c Sep 16 01:47:46.699666 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-User-Name: admin Sep 16 01:47:46.699666 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: method: > Sep 16 01:47:46.699666 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: exception: Flavor 84 could not be found. Sep 16 01:47:46.699666 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: action_args: {'id': '84'} Sep 16 01:47:46.699666 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: {{(pid=105431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 01:47:46.699666 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:47:46.700590 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 16 01:47:46.700590 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 16 01:47:46.700590 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 16 01:47:46.700590 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 16 01:47:46.700590 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 01:47:46.700590 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 01:47:46.700590 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 16 01:47:46.700590 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 16 01:47:46.700590 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 16 01:47:46.700590 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 01:47:46.700590 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 16 01:47:46.700590 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 16 01:47:46.700590 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 16 01:47:46.700590 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi Sep 16 01:47:46.700590 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:47:46.700590 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi Sep 16 01:47:46.700590 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:47:46.700590 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 01:47:46.700590 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 01:47:46.701981 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 01:47:46.701981 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 01:47:46.701981 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 01:47:46.701981 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 01:47:46.701981 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 16 01:47:46.701981 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 01:47:46.701981 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 16 01:47:46.701981 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi Sep 16 01:47:46.701981 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:47:46.701981 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi Sep 16 01:47:46.701981 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:47:46.701981 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 01:47:46.701981 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 01:47:46.701981 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 01:47:46.701981 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 01:47:46.701981 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 16 01:47:46.701981 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi Sep 16 01:47:46.701981 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi [None req-820f157c-3730-46ef-8226-f676e17a6265 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 01:47:46.703214 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: INFO nova.api.openstack.requestlog [None req-820f157c-3730-46ef-8226-f676e17a6265 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.392408 Sep 16 01:47:46.703214 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: [pid: 105431|app: 0|req: 23/44] 10.222.0.42 () {60 vars in 1190 bytes} [Fri Sep 16 01:47:46 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 394 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 16 01:47:46.709499 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi [None req-7892c6f3-0003-461d-b1f2-422dc49bbbc0 admin admin] Calling method '>' {{(pid=105432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:47:46.724840 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: INFO nova.api.openstack.requestlog [None req-7892c6f3-0003-461d-b1f2-422dc49bbbc0 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018874 Sep 16 01:47:46.725304 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: [pid: 105432|app: 0|req: 22/45] 10.222.0.42 () {60 vars in 1210 bytes} [Fri Sep 16 01:47:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:47:46.735092 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi [None req-19ab6525-6677-4d7c-be9b-e5d5ce170199 admin admin] Calling method '>' {{(pid=105431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:47:46.750716 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: INFO nova.api.openstack.requestlog [None req-19ab6525-6677-4d7c-be9b-e5d5ce170199 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019062 Sep 16 01:47:46.751229 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: [pid: 105431|app: 0|req: 24/46] 10.222.0.42 () {60 vars in 1210 bytes} [Fri Sep 16 01:47:46 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:47:46.760633 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi [None req-aa226d1f-f302-4a96-810a-cb9eb0745b48 admin admin] Calling method '>' {{(pid=105432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:47:46.765695 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: INFO nova.api.openstack.wsgi [None req-aa226d1f-f302-4a96-810a-cb9eb0745b48 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 16 01:47:46.767164 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi [None req-aa226d1f-f302-4a96-810a-cb9eb0745b48 admin admin] Request method failure captured: Sep 16 01:47:46.767164 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 16 01:47:46.767164 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: Accept: application/json Sep 16 01:47:46.767164 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: Accept-Encoding: gzip, deflate Sep 16 01:47:46.767164 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: Connection: keep-alive Sep 16 01:47:46.767164 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: Content-Length: 0 Sep 16 01:47:46.767164 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: Host: 10.222.0.42 Sep 16 01:47:46.767164 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: Openstack-Api-Version: compute 2.92 Sep 16 01:47:46.767164 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: Openstack-System-Scope: None Sep 16 01:47:46.767164 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: User-Agent: python-novaclient Sep 16 01:47:46.767164 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-Auth-Token: gAAAAABjI9XCv4GUk1L3Xdgo4KkMotKj8rq_opIeqQBXms6lVU_OCNL8GPBQMHNygDbPSXI_2pQ_xLLJtQjmHqHuMJHSSJ7N2f0T2zqnHTvqJQrTwjngVdEJGcXDrVtxrJGsWcn-KsM7q3E1mR6eFFlUQzNY3xvwDuydL7AdLVzagCZG6QhE4JQ Sep 16 01:47:46.767164 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-Domain-Id: None Sep 16 01:47:46.767164 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-Domain-Name: None Sep 16 01:47:46.767164 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-Identity-Status: Confirmed Sep 16 01:47:46.767164 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-Is-Admin-Project: True Sep 16 01:47:46.767164 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-Openstack-Nova-Api-Version: 2.92 Sep 16 01:47:46.767164 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-Project-Domain-Id: default Sep 16 01:47:46.767164 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-Project-Domain-Name: Default Sep 16 01:47:46.767164 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-Project-Id: efec9f6da9c342038dd7466c677c23ad Sep 16 01:47:46.767164 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-Project-Name: admin Sep 16 01:47:46.767164 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-Role: member,admin,reader Sep 16 01:47:46.767164 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-Roles: member,admin,reader Sep 16 01:47:46.768938 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/efec9f6da9c342038dd7466c677c23ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/efec9f6da9c342038dd7466c677c23ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_efec9f6da9c342038dd7466c677c23ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/efec9f6da9c342038dd7466c677c23ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 01:47:46.768938 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-Tenant: admin Sep 16 01:47:46.768938 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-Tenant-Id: efec9f6da9c342038dd7466c677c23ad Sep 16 01:47:46.768938 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-Tenant-Name: admin Sep 16 01:47:46.768938 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-User: admin Sep 16 01:47:46.768938 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-User-Domain-Id: default Sep 16 01:47:46.768938 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-User-Domain-Name: Default Sep 16 01:47:46.768938 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-User-Id: a00246e1b29a4746b4e48d4dc1f5618c Sep 16 01:47:46.768938 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-User-Name: admin Sep 16 01:47:46.768938 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: method: > Sep 16 01:47:46.768938 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: exception: Flavor 84 could not be found. Sep 16 01:47:46.768938 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: action_args: {'id': '84'} Sep 16 01:47:46.768938 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: {{(pid=105432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 01:47:46.768938 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:47:46.769911 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 16 01:47:46.769911 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 16 01:47:46.769911 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 16 01:47:46.769911 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 16 01:47:46.769911 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 01:47:46.769911 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 01:47:46.769911 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 16 01:47:46.769911 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 16 01:47:46.769911 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 16 01:47:46.769911 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 01:47:46.769911 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 16 01:47:46.769911 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 16 01:47:46.769911 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 16 01:47:46.769911 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi Sep 16 01:47:46.769911 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:47:46.769911 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi Sep 16 01:47:46.769911 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:47:46.769911 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 01:47:46.769911 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 01:47:46.771225 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 01:47:46.771225 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 01:47:46.771225 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 01:47:46.771225 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 01:47:46.771225 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 16 01:47:46.771225 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 01:47:46.771225 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 16 01:47:46.771225 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi Sep 16 01:47:46.771225 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:47:46.771225 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi Sep 16 01:47:46.771225 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:47:46.771225 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 01:47:46.771225 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 01:47:46.771225 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 01:47:46.771225 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 01:47:46.771225 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 16 01:47:46.771225 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi Sep 16 01:47:46.771225 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi [None req-aa226d1f-f302-4a96-810a-cb9eb0745b48 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=105432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 01:47:46.772602 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: INFO nova.api.openstack.requestlog [None req-aa226d1f-f302-4a96-810a-cb9eb0745b48 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011654 Sep 16 01:47:46.772602 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: [pid: 105432|app: 0|req: 23/47] 10.222.0.42 () {60 vars in 1190 bytes} [Fri Sep 16 01:47:46 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 16 01:47:47.982907 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi [None req-19ab6525-6677-4d7c-be9b-e5d5ce170199 admin admin] Calling method '>' {{(pid=105431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:47:47.983964 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: INFO nova.api.openstack.requestlog [None req-19ab6525-6677-4d7c-be9b-e5d5ce170199 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001464 Sep 16 01:47:47.984351 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: [pid: 105431|app: 0|req: 25/48] 10.222.0.42 () {56 vars in 1074 bytes} [Fri Sep 16 01:47:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:47:48.505468 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi [None req-6fad8a0b-c5f3-4c7d-85f0-808f2c472de4 admin admin] Calling method '>' {{(pid=105432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:47:48.511430 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: INFO nova.api.openstack.wsgi [None req-6fad8a0b-c5f3-4c7d-85f0-808f2c472de4 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 16 01:47:48.513590 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi [None req-6fad8a0b-c5f3-4c7d-85f0-808f2c472de4 admin admin] Request method failure captured: Sep 16 01:47:48.513590 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 16 01:47:48.513590 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: Accept: application/json Sep 16 01:47:48.513590 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: Accept-Encoding: gzip, deflate Sep 16 01:47:48.513590 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: Connection: keep-alive Sep 16 01:47:48.513590 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: Content-Length: 0 Sep 16 01:47:48.513590 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: Host: 10.222.0.42 Sep 16 01:47:48.513590 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: Openstack-Api-Version: compute 2.92 Sep 16 01:47:48.513590 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: Openstack-System-Scope: None Sep 16 01:47:48.513590 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: User-Agent: python-novaclient Sep 16 01:47:48.513590 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-Auth-Token: gAAAAABjI9XDJ4jOU6XwpKfIphoob67smImbJ9qYdQSVfTW0AIDT3h6QFkJ_VGm6MdYV-IgJt9MZ0fRiX6eWTSY6G6E8lUvYAiMmMKeQJaQdOKVA2QMWHxhGFEDYgLSeAhvcDBzTCNjAwZtM1jZEP8bKWRtTN3JrpoB_lUSyy8v9JDo9-iEqUsY Sep 16 01:47:48.513590 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-Domain-Id: None Sep 16 01:47:48.513590 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-Domain-Name: None Sep 16 01:47:48.513590 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-Identity-Status: Confirmed Sep 16 01:47:48.513590 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-Is-Admin-Project: True Sep 16 01:47:48.513590 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-Openstack-Nova-Api-Version: 2.92 Sep 16 01:47:48.513590 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-Project-Domain-Id: default Sep 16 01:47:48.513590 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-Project-Domain-Name: Default Sep 16 01:47:48.513590 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-Project-Id: efec9f6da9c342038dd7466c677c23ad Sep 16 01:47:48.513590 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-Project-Name: admin Sep 16 01:47:48.513590 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-Role: member,admin,reader Sep 16 01:47:48.513590 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-Roles: member,admin,reader Sep 16 01:47:48.515049 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/efec9f6da9c342038dd7466c677c23ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/efec9f6da9c342038dd7466c677c23ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_efec9f6da9c342038dd7466c677c23ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/efec9f6da9c342038dd7466c677c23ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 01:47:48.515049 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-Tenant: admin Sep 16 01:47:48.515049 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-Tenant-Id: efec9f6da9c342038dd7466c677c23ad Sep 16 01:47:48.515049 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-Tenant-Name: admin Sep 16 01:47:48.515049 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-User: admin Sep 16 01:47:48.515049 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-User-Domain-Id: default Sep 16 01:47:48.515049 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-User-Domain-Name: Default Sep 16 01:47:48.515049 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-User-Id: a00246e1b29a4746b4e48d4dc1f5618c Sep 16 01:47:48.515049 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: X-User-Name: admin Sep 16 01:47:48.515049 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: method: > Sep 16 01:47:48.515049 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: exception: Flavor 451 could not be found. Sep 16 01:47:48.515049 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: action_args: {'id': '451'} Sep 16 01:47:48.515049 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: {{(pid=105432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 01:47:48.515049 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:47:48.515893 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 16 01:47:48.515893 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 16 01:47:48.515893 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 16 01:47:48.515893 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 16 01:47:48.515893 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 01:47:48.515893 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 01:47:48.515893 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 16 01:47:48.515893 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 16 01:47:48.515893 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 16 01:47:48.515893 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 01:47:48.515893 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 16 01:47:48.515893 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 16 01:47:48.515893 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 16 01:47:48.515893 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi Sep 16 01:47:48.515893 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:47:48.515893 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi Sep 16 01:47:48.515893 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:47:48.515893 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 01:47:48.515893 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 01:47:48.516977 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 01:47:48.516977 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 01:47:48.516977 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 01:47:48.516977 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 01:47:48.516977 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 16 01:47:48.516977 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 01:47:48.516977 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 16 01:47:48.516977 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi Sep 16 01:47:48.516977 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:47:48.516977 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi Sep 16 01:47:48.516977 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:47:48.516977 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 01:47:48.516977 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 01:47:48.516977 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 01:47:48.516977 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 01:47:48.516977 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 16 01:47:48.516977 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: ERROR nova.api.openstack.wsgi Sep 16 01:47:48.516977 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi [None req-6fad8a0b-c5f3-4c7d-85f0-808f2c472de4 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105432) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 01:47:48.518009 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: INFO nova.api.openstack.requestlog [None req-6fad8a0b-c5f3-4c7d-85f0-808f2c472de4 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.394801 Sep 16 01:47:48.518009 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: [pid: 105432|app: 0|req: 24/49] 10.222.0.42 () {60 vars in 1193 bytes} [Fri Sep 16 01:47:48 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 396 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 16 01:47:48.524646 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi [None req-c43b2225-4bc3-4009-adae-702694d81525 admin admin] Calling method '>' {{(pid=105431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:47:48.539561 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: INFO nova.api.openstack.requestlog [None req-c43b2225-4bc3-4009-adae-702694d81525 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018441 Sep 16 01:47:48.540108 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: [pid: 105431|app: 0|req: 26/50] 10.222.0.42 () {60 vars in 1210 bytes} [Fri Sep 16 01:47:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:47:48.549552 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi [None req-03420f60-0d47-4e1c-ae10-033c9e359c01 admin admin] Calling method '>' {{(pid=105432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:47:48.564586 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: INFO nova.api.openstack.requestlog [None req-03420f60-0d47-4e1c-ae10-033c9e359c01 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018585 Sep 16 01:47:48.565155 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: [pid: 105432|app: 0|req: 25/51] 10.222.0.42 () {60 vars in 1210 bytes} [Fri Sep 16 01:47:48 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:47:48.578726 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi [None req-51a78fa9-f68c-4752-bf8d-bde195e2b1ed admin admin] Calling method '>' {{(pid=105431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:47:48.583760 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: INFO nova.api.openstack.wsgi [None req-51a78fa9-f68c-4752-bf8d-bde195e2b1ed admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 16 01:47:48.585296 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi [None req-51a78fa9-f68c-4752-bf8d-bde195e2b1ed admin admin] Request method failure captured: Sep 16 01:47:48.585296 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 16 01:47:48.585296 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: Accept: application/json Sep 16 01:47:48.585296 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: Accept-Encoding: gzip, deflate Sep 16 01:47:48.585296 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: Connection: keep-alive Sep 16 01:47:48.585296 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: Content-Length: 0 Sep 16 01:47:48.585296 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: Host: 10.222.0.42 Sep 16 01:47:48.585296 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: Openstack-Api-Version: compute 2.92 Sep 16 01:47:48.585296 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: Openstack-System-Scope: None Sep 16 01:47:48.585296 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: User-Agent: python-novaclient Sep 16 01:47:48.585296 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-Auth-Token: gAAAAABjI9XDJ4jOU6XwpKfIphoob67smImbJ9qYdQSVfTW0AIDT3h6QFkJ_VGm6MdYV-IgJt9MZ0fRiX6eWTSY6G6E8lUvYAiMmMKeQJaQdOKVA2QMWHxhGFEDYgLSeAhvcDBzTCNjAwZtM1jZEP8bKWRtTN3JrpoB_lUSyy8v9JDo9-iEqUsY Sep 16 01:47:48.585296 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-Domain-Id: None Sep 16 01:47:48.585296 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-Domain-Name: None Sep 16 01:47:48.585296 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-Identity-Status: Confirmed Sep 16 01:47:48.585296 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-Is-Admin-Project: True Sep 16 01:47:48.585296 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-Openstack-Nova-Api-Version: 2.92 Sep 16 01:47:48.585296 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-Project-Domain-Id: default Sep 16 01:47:48.585296 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-Project-Domain-Name: Default Sep 16 01:47:48.585296 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-Project-Id: efec9f6da9c342038dd7466c677c23ad Sep 16 01:47:48.585296 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-Project-Name: admin Sep 16 01:47:48.585296 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-Role: member,admin,reader Sep 16 01:47:48.585296 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-Roles: member,admin,reader Sep 16 01:47:48.586852 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/efec9f6da9c342038dd7466c677c23ad"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/efec9f6da9c342038dd7466c677c23ad"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_efec9f6da9c342038dd7466c677c23ad"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/efec9f6da9c342038dd7466c677c23ad"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 01:47:48.586852 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-Tenant: admin Sep 16 01:47:48.586852 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-Tenant-Id: efec9f6da9c342038dd7466c677c23ad Sep 16 01:47:48.586852 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-Tenant-Name: admin Sep 16 01:47:48.586852 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-User: admin Sep 16 01:47:48.586852 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-User-Domain-Id: default Sep 16 01:47:48.586852 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-User-Domain-Name: Default Sep 16 01:47:48.586852 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-User-Id: a00246e1b29a4746b4e48d4dc1f5618c Sep 16 01:47:48.586852 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: X-User-Name: admin Sep 16 01:47:48.586852 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: method: > Sep 16 01:47:48.586852 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: exception: Flavor 451 could not be found. Sep 16 01:47:48.586852 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: action_args: {'id': '451'} Sep 16 01:47:48.586852 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: {{(pid=105431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 01:47:48.586852 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:47:48.587785 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 16 01:47:48.587785 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 16 01:47:48.587785 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 16 01:47:48.587785 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 16 01:47:48.587785 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 01:47:48.587785 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 01:47:48.587785 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 16 01:47:48.587785 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 16 01:47:48.587785 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 16 01:47:48.587785 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 01:47:48.587785 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 16 01:47:48.587785 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 16 01:47:48.587785 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 16 01:47:48.587785 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi Sep 16 01:47:48.587785 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:47:48.587785 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi Sep 16 01:47:48.587785 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:47:48.587785 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 01:47:48.587785 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 01:47:48.589131 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 01:47:48.589131 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 01:47:48.589131 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 01:47:48.589131 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 01:47:48.589131 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 16 01:47:48.589131 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 01:47:48.589131 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 16 01:47:48.589131 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi Sep 16 01:47:48.589131 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:47:48.589131 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi Sep 16 01:47:48.589131 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:47:48.589131 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 01:47:48.589131 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 01:47:48.589131 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 01:47:48.589131 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 01:47:48.589131 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 16 01:47:48.589131 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: ERROR nova.api.openstack.wsgi Sep 16 01:47:48.589131 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi [None req-51a78fa9-f68c-4752-bf8d-bde195e2b1ed admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=105431) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 01:47:48.590524 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: INFO nova.api.openstack.requestlog [None req-51a78fa9-f68c-4752-bf8d-bde195e2b1ed admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.012617 Sep 16 01:47:48.590524 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: [pid: 105431|app: 0|req: 27/52] 10.222.0.42 () {60 vars in 1193 bytes} [Fri Sep 16 01:47:48 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 14 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 16 01:47:49.817751 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi [None req-03420f60-0d47-4e1c-ae10-033c9e359c01 admin admin] Calling method '>' {{(pid=105432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:47:49.818760 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: INFO nova.api.openstack.requestlog [None req-03420f60-0d47-4e1c-ae10-033c9e359c01 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001443 Sep 16 01:47:49.819151 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: [pid: 105432|app: 0|req: 26/53] 10.222.0.42 () {56 vars in 1074 bytes} [Fri Sep 16 01:47:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:47:50.337939 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi [None req-c299be3e-d5fe-4c92-9541-c45023dbe04a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:47:50.357809 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: INFO nova.api.openstack.requestlog [None req-c299be3e-d5fe-4c92-9541-c45023dbe04a admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.400385 Sep 16 01:47:50.358348 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: [pid: 105431|app: 0|req: 28/54] 10.222.0.42 () {64 vars in 1235 bytes} [Fri Sep 16 01:47:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 01:47:51.588718 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi [None req-03420f60-0d47-4e1c-ae10-033c9e359c01 admin admin] Calling method '>' {{(pid=105432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:47:51.590504 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: INFO nova.api.openstack.requestlog [None req-03420f60-0d47-4e1c-ae10-033c9e359c01 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002128 Sep 16 01:47:51.590902 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: [pid: 105432|app: 0|req: 27/55] 10.222.0.42 () {56 vars in 1074 bytes} [Fri Sep 16 01:47:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:47:52.129734 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi [None req-4b593e1c-9b9c-49e0-9508-0dd25c7caff0 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:47:52.148727 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: INFO nova.api.openstack.requestlog [None req-4b593e1c-9b9c-49e0-9508-0dd25c7caff0 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.418536 Sep 16 01:47:52.149270 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: [pid: 105431|app: 0|req: 29/56] 10.222.0.42 () {64 vars in 1235 bytes} [Fri Sep 16 01:47:51 2022] POST /compute/v2.1/flavors => generated 405 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 01:47:53.373056 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi [None req-03420f60-0d47-4e1c-ae10-033c9e359c01 admin admin] Calling method '>' {{(pid=105432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:47:53.374053 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: INFO nova.api.openstack.requestlog [None req-03420f60-0d47-4e1c-ae10-033c9e359c01 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Sep 16 01:47:53.374442 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: [pid: 105432|app: 0|req: 28/57] 10.222.0.42 () {56 vars in 1074 bytes} [Fri Sep 16 01:47:53 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:47:53.897367 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi [None req-1bee30e0-4ffa-4ab9-972d-4e5b2bfe5dcf admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:47:53.916037 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: INFO nova.api.openstack.requestlog [None req-1bee30e0-4ffa-4ab9-972d-4e5b2bfe5dcf admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.401275 Sep 16 01:47:53.916563 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: [pid: 105431|app: 0|req: 30/58] 10.222.0.42 () {64 vars in 1235 bytes} [Fri Sep 16 01:47:53 2022] POST /compute/v2.1/flavors => generated 407 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 01:47:55.139913 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi [None req-03420f60-0d47-4e1c-ae10-033c9e359c01 admin admin] Calling method '>' {{(pid=105432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:47:55.140939 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: INFO nova.api.openstack.requestlog [None req-03420f60-0d47-4e1c-ae10-033c9e359c01 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001447 Sep 16 01:47:55.145602 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: [pid: 105432|app: 0|req: 29/59] 10.222.0.42 () {56 vars in 1074 bytes} [Fri Sep 16 01:47:55 2022] GET /compute/v2.1 => generated 388 bytes in 7 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:47:55.666199 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi [None req-0fceefe4-f841-43b1-adc4-37bc42862ea4 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=105431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:47:55.685182 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: INFO nova.api.openstack.requestlog [None req-0fceefe4-f841-43b1-adc4-37bc42862ea4 admin admin] 10.222.0.42 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.407812 Sep 16 01:47:55.685712 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: [pid: 105431|app: 0|req: 31/60] 10.222.0.42 () {64 vars in 1235 bytes} [Fri Sep 16 01:47:55 2022] POST /compute/v2.1/flavors => generated 409 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 01:47:56.921862 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi [None req-03420f60-0d47-4e1c-ae10-033c9e359c01 admin admin] Calling method '>' {{(pid=105432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:47:56.922859 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: INFO nova.api.openstack.requestlog [None req-03420f60-0d47-4e1c-ae10-033c9e359c01 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001419 Sep 16 01:47:56.923253 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: [pid: 105432|app: 0|req: 30/61] 10.222.0.42 () {56 vars in 1074 bytes} [Fri Sep 16 01:47:56 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:47:57.440086 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi [None req-7b60c753-96db-4949-abe5-33e7fdca7b21 admin admin] Calling method '>' {{(pid=105431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:47:57.460557 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: INFO nova.api.openstack.requestlog [None req-7b60c753-96db-4949-abe5-33e7fdca7b21 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.401023 Sep 16 01:47:57.460914 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: [pid: 105431|app: 0|req: 32/62] 10.222.0.42 () {60 vars in 1202 bytes} [Fri Sep 16 01:47:57 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:48:54.435133 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi [None req-03420f60-0d47-4e1c-ae10-033c9e359c01 admin admin] Calling method '>' {{(pid=105432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:48:54.436075 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: INFO nova.api.openstack.requestlog [None req-03420f60-0d47-4e1c-ae10-033c9e359c01 admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001448 Sep 16 01:48:54.436497 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: [pid: 105432|app: 0|req: 31/63] 10.222.0.42 () {54 vars in 931 bytes} [Fri Sep 16 01:48:54 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:48:54.448072 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG dbcounter [-] [105431] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=105431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:48:54.828555 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi [None req-5843359a-8560-436c-ae8d-f7dcdef88ee2 admin admin] Calling method '>' {{(pid=105431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:48:54.849230 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: INFO nova.api.openstack.requestlog [None req-5843359a-8560-436c-ae8d-f7dcdef88ee2 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.406310 Sep 16 01:48:54.849764 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: [pid: 105431|app: 0|req: 33/64] 10.222.0.42 () {60 vars in 1292 bytes} [Fri Sep 16 01:48:54 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:48:54.870826 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG dbcounter [-] [105432] Writing DB stats nova_api:SELECT=14 {{(pid=105432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:48:54.874599 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi [None req-495b7bd7-e9ce-41d4-84be-0e6fdd7cc2ba admin admin] Calling method '>' {{(pid=105432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:48:54.881959 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: INFO nova.api.openstack.requestlog [None req-495b7bd7-e9ce-41d4-84be-0e6fdd7cc2ba admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012527 Sep 16 01:48:54.882475 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: [pid: 105432|app: 0|req: 32/65] 10.222.0.42 () {60 vars in 1283 bytes} [Fri Sep 16 01:48:54 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:48:54.894825 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi [None req-c91b7f2e-8a79-4a22-8a62-d887bae44fc2 admin admin] Calling method '>' {{(pid=105431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:48:54.902692 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: INFO nova.api.openstack.requestlog [None req-c91b7f2e-8a79-4a22-8a62-d887bae44fc2 admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011457 Sep 16 01:48:54.903198 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: [pid: 105431|app: 0|req: 34/66] 10.222.0.42 () {60 vars in 1286 bytes} [Fri Sep 16 01:48:54 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:48:54.914212 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi [None req-c5a75f8a-ef58-4997-b937-bcf40702e4df admin admin] Calling method '>' {{(pid=105432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:48:54.921658 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: INFO nova.api.openstack.requestlog [None req-c5a75f8a-ef58-4997-b937-bcf40702e4df admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010962 Sep 16 01:48:54.922163 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: [pid: 105432|app: 0|req: 33/67] 10.222.0.42 () {60 vars in 1286 bytes} [Fri Sep 16 01:48:54 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:48:54.933269 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi [None req-3959a7fb-80eb-4c08-a9a9-f6755aca690b admin admin] Calling method '>' {{(pid=105431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:48:54.940247 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: INFO nova.api.openstack.requestlog [None req-3959a7fb-80eb-4c08-a9a9-f6755aca690b admin admin] 10.222.0.42 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010487 Sep 16 01:48:54.940756 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: [pid: 105431|app: 0|req: 35/68] 10.222.0.42 () {60 vars in 1283 bytes} [Fri Sep 16 01:48:54 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 01:51:50.799887 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi [None req-c5a75f8a-ef58-4997-b937-bcf40702e4df admin admin] Calling method '>' {{(pid=105432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:51:50.800974 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: INFO nova.api.openstack.requestlog [None req-c5a75f8a-ef58-4997-b937-bcf40702e4df admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001473 Sep 16 01:51:50.801365 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: [pid: 105432|app: 0|req: 34/69] 10.222.0.42 () {56 vars in 1074 bytes} [Fri Sep 16 01:51:50 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:51:50.942077 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG dbcounter [-] [105431] Writing DB stats nova_api:SELECT=6 {{(pid=105431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:51:51.101970 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi [None req-763de0e7-e440-4d34-9f34-27fc849b57d5 admin admin] Calling method '>' {{(pid=105431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:51:51.106808 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG oslo_concurrency.lockutils [None req-763de0e7-e440-4d34-9f34-27fc849b57d5 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:51:51.107281 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG oslo_concurrency.lockutils [None req-763de0e7-e440-4d34-9f34-27fc849b57d5 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:51:51.107706 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG oslo_concurrency.lockutils [None req-763de0e7-e440-4d34-9f34-27fc849b57d5 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:51:51.108444 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG oslo_concurrency.lockutils [None req-763de0e7-e440-4d34-9f34-27fc849b57d5 admin admin] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:51:51.108889 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG oslo_concurrency.lockutils [None req-763de0e7-e440-4d34-9f34-27fc849b57d5 admin admin] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:51:51.109304 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG oslo_concurrency.lockutils [None req-763de0e7-e440-4d34-9f34-27fc849b57d5 admin admin] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:51:51.141363 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: INFO nova.api.openstack.requestlog [None req-763de0e7-e440-4d34-9f34-27fc849b57d5 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.200413 Sep 16 01:51:51.141910 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: [pid: 105431|app: 0|req: 36/70] 10.222.0.42 () {60 vars in 1193 bytes} [Fri Sep 16 01:51:50 2022] GET /compute/v2.1/os-services => generated 791 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 01:51:52.231286 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi [None req-c5a75f8a-ef58-4997-b937-bcf40702e4df admin admin] Calling method '>' {{(pid=105432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:51:52.232331 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: INFO nova.api.openstack.requestlog [None req-c5a75f8a-ef58-4997-b937-bcf40702e4df admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001407 Sep 16 01:51:52.232722 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: [pid: 105432|app: 0|req: 35/71] 10.222.0.42 () {56 vars in 1074 bytes} [Fri Sep 16 01:51:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:51:52.433487 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi [None req-2474ab8b-11eb-461c-b311-486b8e148c6e admin admin] Calling method '>' {{(pid=105431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:51:52.436906 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG oslo_concurrency.lockutils [None req-2474ab8b-11eb-461c-b311-486b8e148c6e admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:51:52.437392 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG oslo_concurrency.lockutils [None req-2474ab8b-11eb-461c-b311-486b8e148c6e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:51:52.437820 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG oslo_concurrency.lockutils [None req-2474ab8b-11eb-461c-b311-486b8e148c6e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:51:52.438603 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG oslo_concurrency.lockutils [None req-2474ab8b-11eb-461c-b311-486b8e148c6e admin admin] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:51:52.438984 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG oslo_concurrency.lockutils [None req-2474ab8b-11eb-461c-b311-486b8e148c6e admin admin] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:51:52.439403 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG oslo_concurrency.lockutils [None req-2474ab8b-11eb-461c-b311-486b8e148c6e admin admin] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:51:52.460495 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: INFO nova.api.openstack.requestlog [None req-2474ab8b-11eb-461c-b311-486b8e148c6e admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 791 microversion: 2.92 time: 0.079494 Sep 16 01:51:52.461057 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: [pid: 105431|app: 0|req: 37/72] 10.222.0.42 () {60 vars in 1193 bytes} [Fri Sep 16 01:51:52 2022] GET /compute/v2.1/os-services => generated 791 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 01:52:03.951672 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi [None req-c5a75f8a-ef58-4997-b937-bcf40702e4df admin admin] Calling method '>' {{(pid=105432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:52:03.952701 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: INFO nova.api.openstack.requestlog [None req-c5a75f8a-ef58-4997-b937-bcf40702e4df admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Sep 16 01:52:03.953096 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: [pid: 105432|app: 0|req: 36/73] 10.222.0.42 () {56 vars in 1074 bytes} [Fri Sep 16 01:52:03 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:52:04.096277 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG dbcounter [-] [105431] Writing DB stats nova_cell0:SELECT=4 {{(pid=105431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:52:04.096914 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG dbcounter [-] [105431] Writing DB stats nova_cell1:SELECT=4 {{(pid=105431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:52:04.097550 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG dbcounter [-] [105431] Writing DB stats nova_api:SELECT=8 {{(pid=105431) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:52:04.145416 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi [None req-fd073724-908a-4bfd-9469-58de72221ba9 admin admin] Calling method '>' {{(pid=105431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:52:04.149454 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG oslo_concurrency.lockutils [None req-fd073724-908a-4bfd-9469-58de72221ba9 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:52:04.149954 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG oslo_concurrency.lockutils [None req-fd073724-908a-4bfd-9469-58de72221ba9 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:52:04.150386 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG oslo_concurrency.lockutils [None req-fd073724-908a-4bfd-9469-58de72221ba9 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:52:04.151112 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG oslo_concurrency.lockutils [None req-fd073724-908a-4bfd-9469-58de72221ba9 admin admin] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:52:04.151561 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG oslo_concurrency.lockutils [None req-fd073724-908a-4bfd-9469-58de72221ba9 admin admin] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:52:04.152020 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG oslo_concurrency.lockutils [None req-fd073724-908a-4bfd-9469-58de72221ba9 admin admin] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:52:04.176932 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: INFO nova.api.openstack.requestlog [None req-fd073724-908a-4bfd-9469-58de72221ba9 admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.085154 Sep 16 01:52:04.177483 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: [pid: 105431|app: 0|req: 38/74] 10.222.0.42 () {60 vars in 1193 bytes} [Fri Sep 16 01:52:04 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:52:05.257640 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG nova.api.openstack.wsgi [None req-c5a75f8a-ef58-4997-b937-bcf40702e4df admin admin] Calling method '>' {{(pid=105432) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:52:05.258647 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: INFO nova.api.openstack.requestlog [None req-c5a75f8a-ef58-4997-b937-bcf40702e4df admin admin] 10.222.0.42 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001978 Sep 16 01:52:05.259043 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: [pid: 105432|app: 0|req: 37/75] 10.222.0.42 () {56 vars in 1074 bytes} [Fri Sep 16 01:52:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:52:05.449579 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG nova.api.openstack.wsgi [None req-0843095f-5f25-445f-a838-916f4b92295b admin admin] Calling method '>' {{(pid=105431) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:52:05.453045 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG oslo_concurrency.lockutils [None req-0843095f-5f25-445f-a838-916f4b92295b admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:52:05.453552 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG oslo_concurrency.lockutils [None req-0843095f-5f25-445f-a838-916f4b92295b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=105431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:52:05.453978 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG oslo_concurrency.lockutils [None req-0843095f-5f25-445f-a838-916f4b92295b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:52:05.454684 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG oslo_concurrency.lockutils [None req-0843095f-5f25-445f-a838-916f4b92295b admin admin] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=105431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:52:05.455132 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG oslo_concurrency.lockutils [None req-0843095f-5f25-445f-a838-916f4b92295b admin admin] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=105431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:52:05.455550 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: DEBUG oslo_concurrency.lockutils [None req-0843095f-5f25-445f-a838-916f4b92295b admin admin] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=105431) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:52:05.477690 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: INFO nova.api.openstack.requestlog [None req-0843095f-5f25-445f-a838-916f4b92295b admin admin] 10.222.0.42 "GET /compute/v2.1/os-services" status: 200 len: 1011 microversion: 2.92 time: 0.079615 Sep 16 01:52:05.478168 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: [pid: 105431|app: 0|req: 39/76] 10.222.0.42 () {60 vars in 1193 bytes} [Fri Sep 16 01:52:05 2022] GET /compute/v2.1/os-services => generated 1011 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:53:03.211587 dv-cinder-849143-2-iscsi devstack@n-api.service[105430]: Fri Sep 16 01:53:03 2022 - graceful shutdown triggered... Sep 16 01:53:03.211302 dv-cinder-849143-2-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 16 01:53:03.212631 dv-cinder-849143-2-iscsi devstack@n-api.service[105431]: Gracefully killing worker 1 (pid: 105431)... Sep 16 01:53:03.214527 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: Gracefully killing worker 2 (pid: 105432)... Sep 16 01:53:03.342670 dv-cinder-849143-2-iscsi devstack@n-api.service[105432]: DEBUG dbcounter [-] [105432] Writing DB stats nova_api:SELECT=4 {{(pid=105432) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:53:04.212055 dv-cinder-849143-2-iscsi devstack@n-api.service[105430]: worker 1 buried after 1 seconds Sep 16 01:53:04.212575 dv-cinder-849143-2-iscsi devstack@n-api.service[105430]: worker 2 buried after 1 seconds Sep 16 01:53:04.212575 dv-cinder-849143-2-iscsi devstack@n-api.service[105430]: goodbye to uWSGI. Sep 16 01:53:04.214189 dv-cinder-849143-2-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 16 01:53:04.214738 dv-cinder-849143-2-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 16 01:53:04.217550 dv-cinder-849143-2-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 16 01:53:04.226681 dv-cinder-849143-2-iscsi devstack@n-api.service[120428]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 16 01:53:04.228843 dv-cinder-849143-2-iscsi devstack@n-api.service[120428]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 16 01:53:04 2022] *** Sep 16 01:53:04.228843 dv-cinder-849143-2-iscsi devstack@n-api.service[120428]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 16 01:53:04.228843 dv-cinder-849143-2-iscsi devstack@n-api.service[120428]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 16 01:53:04.228843 dv-cinder-849143-2-iscsi devstack@n-api.service[120428]: nodename: dv-cinder-849143-2-iscsi Sep 16 01:53:04.228843 dv-cinder-849143-2-iscsi devstack@n-api.service[120428]: machine: x86_64 Sep 16 01:53:04.228843 dv-cinder-849143-2-iscsi devstack@n-api.service[120428]: clock source: unix Sep 16 01:53:04.228843 dv-cinder-849143-2-iscsi devstack@n-api.service[120428]: pcre jit disabled Sep 16 01:53:04.228843 dv-cinder-849143-2-iscsi devstack@n-api.service[120428]: detected number of CPU cores: 4 Sep 16 01:53:04.228843 dv-cinder-849143-2-iscsi devstack@n-api.service[120428]: current working directory: / Sep 16 01:53:04.228843 dv-cinder-849143-2-iscsi devstack@n-api.service[120428]: detected binary path: /usr/bin/uwsgi-core Sep 16 01:53:04.228843 dv-cinder-849143-2-iscsi devstack@n-api.service[120428]: your processes number limit is 47680 Sep 16 01:53:04.228843 dv-cinder-849143-2-iscsi devstack@n-api.service[120428]: your memory page size is 4096 bytes Sep 16 01:53:04.228843 dv-cinder-849143-2-iscsi devstack@n-api.service[120428]: detected max file descriptor number: 2048 Sep 16 01:53:04.228843 dv-cinder-849143-2-iscsi devstack@n-api.service[120428]: lock engine: pthread robust mutexes Sep 16 01:53:04.230016 dv-cinder-849143-2-iscsi devstack@n-api.service[120428]: thunder lock: enabled Sep 16 01:53:04.230016 dv-cinder-849143-2-iscsi devstack@n-api.service[120428]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 16 01:53:04.230016 dv-cinder-849143-2-iscsi devstack@n-api.service[120428]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 16 01:53:04.269000 dv-cinder-849143-2-iscsi devstack@n-api.service[120428]: Python main interpreter initialized at 0x55aad59319c0 Sep 16 01:53:04.269000 dv-cinder-849143-2-iscsi devstack@n-api.service[120428]: python threads support enabled Sep 16 01:53:04.269000 dv-cinder-849143-2-iscsi devstack@n-api.service[120428]: your server socket listen backlog is limited to 100 connections Sep 16 01:53:04.269000 dv-cinder-849143-2-iscsi devstack@n-api.service[120428]: your mercy for graceful operations on workers is 90 seconds Sep 16 01:53:04.269431 dv-cinder-849143-2-iscsi devstack@n-api.service[120428]: mapped 403077 bytes (393 KB) for 2 cores Sep 16 01:53:04.269431 dv-cinder-849143-2-iscsi devstack@n-api.service[120428]: *** Operational MODE: preforking *** Sep 16 01:53:04.269711 dv-cinder-849143-2-iscsi devstack@n-api.service[120428]: *** uWSGI is running in multiple interpreter mode *** Sep 16 01:53:04.269711 dv-cinder-849143-2-iscsi devstack@n-api.service[120428]: spawned uWSGI master process (pid: 120428) Sep 16 01:53:04.269912 dv-cinder-849143-2-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 16 01:53:04.270839 dv-cinder-849143-2-iscsi devstack@n-api.service[120428]: spawned uWSGI worker 1 (pid: 120440, cores: 1) Sep 16 01:53:04.270839 dv-cinder-849143-2-iscsi devstack@n-api.service[120428]: spawned uWSGI worker 2 (pid: 120441, cores: 1) Sep 16 01:53:04.271035 dv-cinder-849143-2-iscsi devstack@n-api.service[120428]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 16 01:53:04.945277 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 16 01:53:04.949476 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 16 01:53:06.104823 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 01:53:06.104823 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: from cryptography.utils import int_from_bytes Sep 16 01:53:06.105417 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 01:53:06.105417 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: from cryptography.utils import int_from_bytes Sep 16 01:53:06.129569 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 01:53:06.129569 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: from cryptography.utils import int_from_bytes Sep 16 01:53:06.130118 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 01:53:06.130118 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: from cryptography.utils import int_from_bytes Sep 16 01:53:08.546291 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 16 01:53:08.546913 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 16 01:53:08.547017 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 16 01:53:08.547367 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 16 01:53:08.547626 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 16 01:53:08.548039 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.548375 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.548702 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.549028 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.549362 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.549642 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 16 01:53:08.550033 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.550578 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 16 01:53:08.550666 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.550666 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.550808 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 16 01:53:08.550894 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.550971 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 16 01:53:08.551051 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.551120 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 16 01:53:08.551198 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.551542 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.551648 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849143-2-iscsi {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.551722 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.551957 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.552374 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.552529 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.552681 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.552851 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.553012 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.553161 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.553302 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.553553 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.553708 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.553970 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.554169 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.554310 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.554448 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.554448 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.554730 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.554897 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.554897 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-849143-2-iscsi {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.555190 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.555458 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.555767 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.556116 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.556376 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.556545 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.556927 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.557180 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.557486 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.557749 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.558004 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.558333 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.558556 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.558785 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.559009 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.559213 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.559418 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.559630 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.559862 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.560122 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.560334 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.560539 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.560722 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.560894 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.561110 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.561256 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.561413 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849143-2-iscsi {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.561592 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.561738 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.561891 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.562039 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.562211 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-849143-2-iscsi {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.562360 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.562517 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.562665 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.562815 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.562972 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.563134 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.563530 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.563694 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.563854 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.564037 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.564191 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.564337 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.564476 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.564786 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.564948 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.565451 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.565848 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.565942 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.566026 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.566263 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.566358 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.566468 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.566554 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.566642 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.566731 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.566845 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.566953 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.567046 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.567129 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.567211 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.567306 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.567390 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.567471 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.567572 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.567662 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.568104 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.568215 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.568302 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.568390 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.568480 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.568480 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.568648 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.568744 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.568836 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.568836 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.568998 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.569091 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.569183 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.569275 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.569367 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.569367 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.569524 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.569616 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.569705 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.569794 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.569885 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.570064 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.570165 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.570371 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.570468 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.570677 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.570772 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.570982 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.571072 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.571286 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.571383 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.571592 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.571681 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.571921 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.572042 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.572366 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.572457 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.572734 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.572962 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.573052 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.573294 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.573393 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.573621 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.573766 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.573933 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.574022 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.574255 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.574345 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.574653 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.42 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.574752 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.574907 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.42 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.574997 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.575221 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.575366 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.575562 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.575686 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.575883 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.576023 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.576225 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.576339 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.576539 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.576653 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.576848 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.576954 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.577176 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.577294 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.577492 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.577591 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.577804 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.577956 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.578051 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.578149 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.578348 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.578461 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.578659 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.578774 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.578959 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.579063 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.579259 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.579356 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.579564 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.579674 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.579877 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.580038 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.580206 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.580308 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.580507 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.580608 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.580814 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.580915 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.581111 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.581215 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.581416 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.581510 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.581720 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.581827 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.582023 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.582124 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.582328 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.582420 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.582636 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.582728 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.582939 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.583032 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.583240 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.583342 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.583542 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.583636 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.583843 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.583976 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.584178 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.584272 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.584492 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.584584 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.584804 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.584906 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.585106 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.585197 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.585410 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.585511 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.585764 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.585885 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.586063 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.586327 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.586440 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.586524 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.588101 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.588232 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.588307 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.588409 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.588495 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.588596 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.588703 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.588860 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.588860 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.588998 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.589073 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.589144 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.589219 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.589305 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.589382 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.589684 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.589779 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.589893 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.589974 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.590194 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.590282 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.590502 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.590580 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.591979 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.592352 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.592352 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.592526 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.592609 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.592690 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.592769 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.592855 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.592927 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.592995 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.593069 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.593139 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.593668 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.593789 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.593878 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.593957 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.594035 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.594106 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.594182 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.594404 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.594503 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.594590 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.594673 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.594754 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.594850 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.594940 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.595024 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.595111 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.595190 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.595272 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.595364 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 01:53:08.595448 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.595539 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.595737 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.595863 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.596095 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.596231 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.596421 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.596543 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.596730 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.596876 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.597064 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.597228 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.597376 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.597527 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.597670 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.597810 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.597960 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.598231 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.598384 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.598536 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.598695 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.598934 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.599109 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.599254 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.599404 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.599701 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.599961 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.600112 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.600253 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.600412 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.600573 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.600713 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.600852 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.600998 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.601145 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.601294 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.601435 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.601581 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.601720 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.601867 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.602013 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.602162 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.602302 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.602459 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.602459 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.602724 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.602872 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.603012 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.603300 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.603992 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.604144 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.604331 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.604331 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.604731 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.604879 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.605039 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.605187 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.605326 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.605489 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.605632 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.605772 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.605918 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.606152 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.606306 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.606458 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.606775 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.606878 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.607035 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.607122 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.607287 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.607415 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.607501 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.607572 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.607702 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.607795 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.607926 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.608155 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.608337 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.608488 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.608574 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.608780 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.608919 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.609237 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.609346 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.609432 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.609624 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.609892 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.610020 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.610107 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.610266 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.610377 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.610586 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.610690 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.610905 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.610995 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.611225 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.611314 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.611536 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.611637 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.611876 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.612075 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.612162 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.612276 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.612500 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.612613 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.612781 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.612888 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.613082 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.613176 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.613388 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.613493 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.613690 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.613825 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.614011 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.614140 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.614339 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.614484 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.614646 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.614799 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.614976 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.615117 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.615279 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.615434 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.615585 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.615749 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.615893 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.616086 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.616237 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.616413 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.616539 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.616727 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.616850 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.617038 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.617142 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.617372 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.617507 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.617690 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.617790 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.618000 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.618114 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.618328 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.618427 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.618639 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.618797 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.618979 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.619092 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.619369 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.619526 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.619627 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.619840 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.620148 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.620248 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.620347 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.620485 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.620607 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.620802 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.620911 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.621115 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.621227 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.621438 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.621537 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.621749 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.621846 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.622060 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.622164 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.622399 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.622503 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.622724 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.622912 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.623028 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.623140 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.623349 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.623487 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.623657 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.623755 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.623989 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.624094 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.624293 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.624382 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.624601 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.624690 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.624903 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.625000 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.625209 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.625307 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.625511 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.625606 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.625814 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.625986 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.626114 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.626213 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.626419 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.626530 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.626716 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.626812 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.627017 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.627129 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.627320 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.627430 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.627628 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.627719 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.627943 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.628047 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.628262 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.628381 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.628611 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.628716 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.628920 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.629018 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.629265 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.629354 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.629601 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.629701 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.629924 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.630014 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.630254 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.630356 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.630827 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.630930 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.631146 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.631235 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.631456 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.631552 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.631771 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.631860 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.632103 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.632207 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.632417 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.632514 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.632733 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.632824 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.633047 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.633157 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.633368 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.633479 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.633681 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.633795 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.633996 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.634092 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.634303 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.634446 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.634652 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.634874 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.634971 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.635268 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.635364 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.635621 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.635718 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.635906 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.636064 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.636249 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.636347 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.636579 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.636684 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.636899 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.637018 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.637210 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.637308 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.637542 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.637646 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.637821 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.637911 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.638131 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.638227 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.638438 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.638537 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.638746 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.638841 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.639055 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.639153 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.639364 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.639464 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.639699 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.639819 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.640008 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.640127 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.640326 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.640431 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.640633 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.640722 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.640944 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.641044 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.641247 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.641349 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.641563 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.641653 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.641864 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.641953 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.642179 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.642284 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.642497 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.642602 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.642823 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.642928 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.643127 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.643223 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.643437 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.643542 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.643747 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.643850 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.644077 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.644173 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.644386 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.644481 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.644693 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.644802 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.644997 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.645093 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.645302 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.645399 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.645610 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.645716 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.645915 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.646020 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.646219 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.646322 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.646525 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.646635 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.646829 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.646924 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.647136 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.647233 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.647600 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.647728 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.647864 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.647978 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.648055 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.648350 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.648492 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.648644 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.648740 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.648908 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.649005 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.649097 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.649273 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.649409 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.649575 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.649816 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.649936 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.650576 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.650781 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.650882 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.651268 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.651376 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.651581 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.651679 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.651888 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.652026 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.652223 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.652322 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.652529 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.652629 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.652862 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.652958 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.653174 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.653269 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.653479 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.653578 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.653796 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.653931 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.654108 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.654223 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.654417 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.654526 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.654732 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.654822 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.655042 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.655131 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.655350 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.655449 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.655664 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.655840 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.656004 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.656096 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.656317 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.656417 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.656642 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.656778 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.656939 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.657030 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.657250 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.657350 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.657576 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.657811 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.657906 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.657996 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.658170 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.658269 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.658479 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.658567 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.658789 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.658880 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.659094 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.659370 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.659461 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.659706 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.659862 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.660056 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.660311 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.660419 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.660695 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.660809 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.660970 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.661171 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.661293 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.661385 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.661646 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.661746 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.661967 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.662065 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.662281 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.662377 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.662595 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.662685 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.662904 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.663001 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.663213 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.663312 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.663521 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.663610 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.663826 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.663922 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.664157 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.664259 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.664464 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.664559 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.664768 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.664871 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.665074 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.665170 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.665375 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.665463 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.666286 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.666403 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.666724 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.666818 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.667052 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.667242 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.667363 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.667555 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.667680 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.667871 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.668034 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.668218 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.668337 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.668528 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.668652 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.668841 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.668961 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.669146 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.669270 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.669471 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.669574 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.669862 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.669982 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.670079 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.670241 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.670379 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.670553 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.670682 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.670890 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.671029 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.671232 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.671377 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.671529 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.671662 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.671838 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.672217 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.672377 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.672468 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.672553 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.672729 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.672819 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.673040 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.673132 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.673365 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.673461 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.673671 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.673775 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.673975 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.674072 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.674275 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.674364 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.674583 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.674673 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.674891 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.674982 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.675191 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.675288 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.675494 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.675583 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.675803 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.675893 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.676135 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.676224 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.676455 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.676544 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.676756 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.676854 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.677064 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.677156 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.677367 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.677474 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.677678 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.677768 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.677989 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.678107 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.678294 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.678406 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.678593 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.678690 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.678900 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.678990 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.679206 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.679306 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.679508 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.679605 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.679814 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.679903 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.680140 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.680259 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.680468 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.680559 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.680747 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.680839 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.681051 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.681152 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.681519 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.681720 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.681802 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.682032 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.682152 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.682379 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.682469 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.682689 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.682785 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.682993 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.683096 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.683303 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.683393 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.683616 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.683707 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.683920 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.684043 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.684262 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.684360 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.684568 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.684657 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.684868 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.684957 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.685176 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.685273 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.685486 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.685576 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.685794 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.685892 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.686095 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.686184 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.686397 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.686487 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.686697 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.686786 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.686999 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.687086 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.687300 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.687389 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.687605 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.687695 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.687904 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.688024 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.688234 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.688347 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.688533 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.688624 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.688835 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.688931 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.689136 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.689306 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.689457 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.689554 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.689765 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.689864 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.690068 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.690222 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.690372 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.690585 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.690686 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.690771 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.691004 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.691151 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.691308 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.691406 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.691653 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.691745 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.691982 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.692077 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.692293 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.692383 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.692612 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.692702 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.692926 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.693016 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.693244 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.693342 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.693557 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.693648 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.693858 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.693955 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.694174 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.694264 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.694485 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.694582 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.694799 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.694896 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.695102 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.695193 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.695405 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.695508 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.695725 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.695815 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.696058 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.696160 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.696371 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.696469 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.696685 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.696774 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.697530 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.697633 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.697849 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.698141 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.698293 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.698458 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.698576 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.698773 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.698886 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.699084 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.699175 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.699394 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.699484 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.699707 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.699802 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.700041 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.700146 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.700356 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.700449 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.700672 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.700789 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.700975 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.701072 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.701285 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.701384 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.701595 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.701705 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.701902 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.701992 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.702211 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.702309 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.702520 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.702653 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.702825 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.702920 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.703134 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.703223 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.703449 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.703577 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.703762 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.703905 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.704142 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.704320 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.704427 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.704633 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.704724 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.704951 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.705050 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.705269 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.705404 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.705592 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.705717 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.705914 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.706030 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.706225 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.706324 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.706633 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.706722 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.706945 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.707049 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.707265 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.707364 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.707578 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.707666 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.707883 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.708041 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.708243 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.708388 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.708568 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.708683 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.708900 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.709002 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.709212 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.709318 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.709523 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.709611 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.709827 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.709918 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.710139 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.710232 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.710468 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.710601 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.710741 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.710843 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.711048 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.711191 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.711350 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.711510 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.711673 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.711821 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.712000 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.712274 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.712379 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.713266 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.713458 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.713550 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.713874 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.713998 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.714307 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.714404 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.714640 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.714740 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.714954 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.715045 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.715276 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.715378 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.715594 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.715691 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.715924 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.716043 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.716280 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.716384 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.716586 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.716676 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.716901 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.716994 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.717210 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.717309 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.717533 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.717669 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.717856 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.717981 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.718169 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.718309 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.718486 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.718587 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.718796 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.718909 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.719136 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.719237 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.719442 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.719533 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.719758 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.719855 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.720107 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.720200 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.720486 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.720575 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.720799 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.720906 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.721119 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.721248 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.721434 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.721540 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.721745 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.721977 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.722081 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.722173 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.722347 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.722444 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.722659 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.722758 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.722968 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.723067 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.723276 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.723423 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.723583 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.723682 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.723899 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.724028 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.724237 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.724328 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.724548 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.724652 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.724855 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.724945 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.725160 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.725251 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.725465 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.725556 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.725787 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.725888 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.726092 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.726227 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.726416 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.726520 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.726729 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.726845 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.727040 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.727134 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.727352 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.727443 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.727656 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.727745 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.728001 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.728139 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.728380 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.728485 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.728876 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.728987 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.729220 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.729343 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.729554 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.729645 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.729872 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.729963 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.730212 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.730312 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.730544 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.730642 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.730871 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.730961 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.731191 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.731322 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.731501 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.731605 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.731830 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.732008 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.732166 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.732258 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.732475 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.732565 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.732783 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.732873 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.733092 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.733218 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.733407 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.733552 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.733711 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.733808 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.734015 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.734106 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.734320 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.734426 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.734620 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.734710 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.734922 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.735012 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.735222 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.735318 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.735532 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.735635 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.735831 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.735921 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.736160 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.736252 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.736462 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.736566 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.736775 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.736864 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.737075 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.737165 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.737396 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.737496 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.737705 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.737796 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.738006 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.738105 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.738311 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.738457 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.738613 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.738739 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.738953 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.739066 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.739260 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.739381 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.739580 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.739692 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.739885 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.740004 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.740233 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.740329 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.740547 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.740632 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.740864 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.740952 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.741176 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.741294 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.741493 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.741652 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.741805 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.741904 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.742119 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.742211 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.742430 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.742643 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.742753 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.742977 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.743082 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.743296 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.743386 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.743612 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.743709 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.743972 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.744343 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.744469 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.744730 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.744821 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.745049 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.745150 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.745366 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.745465 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.745682 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.745774 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.745997 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.746162 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.746311 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.746401 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.746622 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.746714 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.746932 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.747025 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.747242 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.747332 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.747550 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.747642 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.747878 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.747997 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.748242 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.748343 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.748564 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.748654 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.748896 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.749001 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.749213 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.749305 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.749531 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.749759 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.749850 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.749942 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.750144 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.750244 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.750461 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.750560 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.750778 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.750884 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.751091 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.751194 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.751394 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.751504 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.751707 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.751801 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.752044 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.752188 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.752354 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.752446 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.752664 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.752761 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.752975 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.753074 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.753285 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.753376 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.753596 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.753686 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.753903 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.754002 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.754213 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.754313 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.754525 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.754616 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.754847 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.754952 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.755178 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.755372 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.755745 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.755955 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.756096 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.756306 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.756398 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.756636 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.756734 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.756966 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.757218 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.757319 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.757532 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.757624 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.757860 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.757957 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.758181 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.758273 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.758501 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.758648 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.758816 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.758906 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.759129 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.759223 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.760004 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.760121 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.760339 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.760572 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.760672 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.760931 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.761023 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.761250 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.761348 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.761563 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.761662 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.761871 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.762101 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.762192 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.762461 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.762560 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.762786 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.762876 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.763106 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.763204 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.763416 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.763515 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.763752 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.763986 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.764085 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.764327 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.764432 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.764644 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.764735 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.764968 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.765060 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.765292 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.765395 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.765607 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.765699 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.765914 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.766005 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.766220 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.766322 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.766528 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.766626 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.766832 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.766922 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.767136 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.767239 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.767442 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.767538 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.767745 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.767842 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.768089 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.768195 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.768401 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.768493 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.768709 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.768799 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.769011 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.769140 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.769320 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.769419 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.769620 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.769711 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.769925 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.770072 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.770238 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.770367 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.770540 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.770643 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.770841 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.770942 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.771147 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.771239 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.771446 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.771549 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.771746 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.771881 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.772062 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.772190 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.772366 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.772507 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.772677 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.772822 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.772979 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.773133 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.773368 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.773468 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.773672 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.773778 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.773985 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.774085 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.774343 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.774484 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.774651 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.774749 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.774954 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.775086 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.775875 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.776336 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.776426 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.776509 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.776592 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.776703 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.776863 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.777021 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.777331 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.777420 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.777652 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.777752 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.777963 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.778066 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.778272 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.778362 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.778616 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.778708 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.778934 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.779029 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.779272 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.779467 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.779582 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.779800 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.779912 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.780148 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.780241 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.780479 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.780587 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.780805 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.780905 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.781113 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.781204 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.781418 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.781552 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.781721 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.781814 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.782041 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.782132 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.782347 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.782437 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.782658 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.782748 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.782962 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.783051 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.783269 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.783371 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.783574 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.783663 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.783880 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.783992 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.784218 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.784321 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.784524 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.784621 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.784830 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.784921 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.785137 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.785236 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.785444 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.785542 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.785750 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.785878 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.786056 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.786181 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.786360 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.786482 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.786670 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.786787 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.786985 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.787116 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.787297 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.787414 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.787683 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.787813 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.788032 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.788157 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.788297 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.788393 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.788542 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.788643 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.788849 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.788989 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.789154 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.789278 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.789459 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.789601 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.789773 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.789927 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.790099 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.790242 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.790409 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.790658 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.790755 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.790956 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.791287 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.791521 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.791669 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.791786 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.791901 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.792141 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.792271 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.792469 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.792620 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.792780 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.792928 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.793101 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.793260 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.793423 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.793571 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.793734 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.793881 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.794060 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.794202 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.794370 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.794495 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.794697 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.794816 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.795033 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.795122 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.795362 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.795454 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.795685 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.795811 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.796056 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.796169 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.796342 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.796465 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.796606 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.796731 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.796914 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.797031 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.797219 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.797349 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.797525 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.797640 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.797826 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.797956 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.798126 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.798243 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.798429 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.798546 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.798729 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.798858 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.799031 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.799146 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.799328 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.799443 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.799630 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.799761 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.799951 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.800069 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.800254 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.800380 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.800554 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.800711 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.800917 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.801040 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.801151 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.801259 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.801426 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.801551 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.801725 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.801845 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.802030 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.802125 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.802330 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.802449 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.802630 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.802761 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.802928 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.803033 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.803227 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.803319 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.803525 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.803616 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.803852 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.804442 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.804585 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.804705 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.804816 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.804924 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.805040 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.805160 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.805278 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.805388 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.805503 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.805612 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.805720 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.805838 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.806018 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.806141 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.806363 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.806482 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.806725 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.806951 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.807077 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.807274 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.807391 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.807608 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.807736 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.807919 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.808058 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.808254 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.808379 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.808569 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.808695 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.808879 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.808997 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.809187 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.809304 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.809550 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.809670 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.809813 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.809929 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.810139 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.810234 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.810444 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.810536 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.810769 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.810889 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.811088 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.811203 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.811408 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.811518 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.811717 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.811843 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.812055 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.812169 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.812378 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.812472 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.812687 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.812774 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.812998 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.813100 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.813305 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.813396 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.813616 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.813714 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.813928 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.814019 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.814249 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.814384 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.814558 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.814656 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.814867 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.814959 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.815181 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.815273 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.815493 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.815583 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.815815 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.815906 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.816165 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.816265 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.816473 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.816645 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.816740 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120441) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 16 01:53:08.816831 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.817105 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.817450 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.817760 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.818099 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.818426 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.818741 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.819052 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.819356 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 01:53:08.819599 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=120440) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 16 01:53:08.880161 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO dbcounter [None req-9a837839-0fe0-4b6a-8ac6-d283bed9ed29 None None] Registered counter for database nova_api Sep 16 01:53:08.883486 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO dbcounter [None req-06dbc6ad-d2d5-477e-a86f-79840f5cb250 None None] Registered counter for database nova_api Sep 16 01:53:08.900734 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_db.sqlalchemy.engines [None req-9a837839-0fe0-4b6a-8ac6-d283bed9ed29 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120441) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 01:53:08.903240 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_db.sqlalchemy.engines [None req-06dbc6ad-d2d5-477e-a86f-79840f5cb250 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120440) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 01:53:08.907450 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writer thread running {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 01:53:08.909763 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writer thread running {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 01:53:08.964922 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.context [None req-9a837839-0fe0-4b6a-8ac6-d283bed9ed29 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c617f603-de26-4777-9f52-27e34617b162(cell1) {{(pid=120441) load_cells /opt/stack/nova/nova/context.py:464}} Sep 16 01:53:08.967971 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.context [None req-06dbc6ad-d2d5-477e-a86f-79840f5cb250 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),c617f603-de26-4777-9f52-27e34617b162(cell1) {{(pid=120440) load_cells /opt/stack/nova/nova/context.py:464}} Sep 16 01:53:08.969018 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9a837839-0fe0-4b6a-8ac6-d283bed9ed29 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:53:08.969506 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9a837839-0fe0-4b6a-8ac6-d283bed9ed29 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:53:08.971104 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9a837839-0fe0-4b6a-8ac6-d283bed9ed29 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:53:08.971855 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9a837839-0fe0-4b6a-8ac6-d283bed9ed29 None None] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:53:08.972334 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9a837839-0fe0-4b6a-8ac6-d283bed9ed29 None None] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:53:08.973042 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-06dbc6ad-d2d5-477e-a86f-79840f5cb250 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:53:08.973518 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-06dbc6ad-d2d5-477e-a86f-79840f5cb250 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:53:08.974364 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9a837839-0fe0-4b6a-8ac6-d283bed9ed29 None None] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:53:08.975086 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-06dbc6ad-d2d5-477e-a86f-79840f5cb250 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:53:08.975816 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-06dbc6ad-d2d5-477e-a86f-79840f5cb250 None None] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:53:08.976290 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-06dbc6ad-d2d5-477e-a86f-79840f5cb250 None None] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:53:08.976413 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO dbcounter [None req-9a837839-0fe0-4b6a-8ac6-d283bed9ed29 None None] Registered counter for database nova_cell0 Sep 16 01:53:08.978335 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-06dbc6ad-d2d5-477e-a86f-79840f5cb250 None None] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:53:08.980750 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO dbcounter [None req-9a837839-0fe0-4b6a-8ac6-d283bed9ed29 None None] Registered counter for database nova_cell1 Sep 16 01:53:08.980869 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO dbcounter [None req-06dbc6ad-d2d5-477e-a86f-79840f5cb250 None None] Registered counter for database nova_cell0 Sep 16 01:53:08.984760 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO dbcounter [None req-06dbc6ad-d2d5-477e-a86f-79840f5cb250 None None] Registered counter for database nova_cell1 Sep 16 01:53:08.988657 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_db.sqlalchemy.engines [None req-9a837839-0fe0-4b6a-8ac6-d283bed9ed29 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120441) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 01:53:08.990175 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_db.sqlalchemy.engines [None req-9a837839-0fe0-4b6a-8ac6-d283bed9ed29 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120441) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 01:53:08.992707 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_db.sqlalchemy.engines [None req-06dbc6ad-d2d5-477e-a86f-79840f5cb250 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120440) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 01:53:08.993831 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_db.sqlalchemy.engines [None req-06dbc6ad-d2d5-477e-a86f-79840f5cb250 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120440) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 01:53:08.995623 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writer thread running {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 01:53:09.000843 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writer thread running {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 01:53:09.005217 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writer thread running {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 01:53:09.140203 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writer thread running {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 01:53:09.151717 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO dbcounter [None req-9a837839-0fe0-4b6a-8ac6-d283bed9ed29 None None] Registered counter for database nova_cell0 Sep 16 01:53:09.158241 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_db.sqlalchemy.engines [None req-9a837839-0fe0-4b6a-8ac6-d283bed9ed29 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120441) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 01:53:09.159821 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO dbcounter [None req-06dbc6ad-d2d5-477e-a86f-79840f5cb250 None None] Registered counter for database nova_cell0 Sep 16 01:53:09.163543 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writer thread running {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 01:53:09.167247 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_db.sqlalchemy.engines [None req-06dbc6ad-d2d5-477e-a86f-79840f5cb250 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=120440) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 01:53:09.172238 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writer thread running {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 01:53:09.492396 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: WARNING keystonemiddleware.auth_token [None req-9a837839-0fe0-4b6a-8ac6-d283bed9ed29 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 16 01:53:09.500051 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: WARNING keystonemiddleware.auth_token [None req-9a837839-0fe0-4b6a-8ac6-d283bed9ed29 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 16 01:53:09.505892 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: WARNING keystonemiddleware.auth_token [None req-06dbc6ad-d2d5-477e-a86f-79840f5cb250 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 16 01:53:09.514092 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: WARNING keystonemiddleware.auth_token [None req-06dbc6ad-d2d5-477e-a86f-79840f5cb250 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 16 01:53:09.848198 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: WARNING keystonemiddleware.auth_token [None req-9a837839-0fe0-4b6a-8ac6-d283bed9ed29 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 16 01:53:09.854336 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: WARNING keystonemiddleware.auth_token [None req-9a837839-0fe0-4b6a-8ac6-d283bed9ed29 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 16 01:53:09.859650 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55aad59319c0 pid: 120441 (default app) Sep 16 01:53:09.864369 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: WARNING keystonemiddleware.auth_token [None req-06dbc6ad-d2d5-477e-a86f-79840f5cb250 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 16 01:53:09.871171 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: WARNING keystonemiddleware.auth_token [None req-06dbc6ad-d2d5-477e-a86f-79840f5cb250 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 16 01:53:09.876409 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55aad59319c0 pid: 120440 (default app) Sep 16 01:53:45.224999 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_api:SELECT=3 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:53:45.226068 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell1:SELECT=3 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:53:45.227628 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell0:SELECT=3 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:53:45.228389 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell0:SELECT=3 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:53:46.737814 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-1f39bf7e-3f8d-42a0-aa15-52f2b24eccd3 tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] Action: 'create', calling method: .version_select at 0x7fae33a6d4c0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-1072663007"}} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:53:48.774416 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-1f39bf7e-3f8d-42a0-aa15-52f2b24eccd3 tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 345 microversion: 2.1 time: 3.559765 Sep 16 01:53:48.784985 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 1/1] 10.222.0.42 () {60 vars in 1155 bytes} [Fri Sep 16 01:53:45 2022] POST /compute/v2.1/os-volumes => generated 345 bytes in 3562 msecs (HTTP/1.1 200) 10 headers in 448 bytes (2 switches on core 0) Sep 16 01:53:48.793989 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_api:SELECT=3 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:53:48.795021 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell1:SELECT=3 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:53:48.796511 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell0:SELECT=3 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:53:48.805231 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell0:SELECT=3 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:53:49.311883 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-b7ee1503-d135-4442-839e-b80279d41965 tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] Calling method '.version_select at 0x7fae33ab7160>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:53:49.991419 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-b7ee1503-d135-4442-839e-b80279d41965 tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/8ed9f915-3925-4176-bf07-80b780aa75c9" status: 200 len: 345 microversion: 2.1 time: 1.203351 Sep 16 01:53:49.993686 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 1/2] 10.222.0.42 () {58 vars in 1245 bytes} [Fri Sep 16 01:53:48 2022] GET /compute/v2.1/os-volumes/8ed9f915-3925-4176-bf07-80b780aa75c9 => generated 345 bytes in 1208 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:53:51.008822 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-67335e57-4acf-434f-87b1-cd9cf8fff4ec tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] Calling method '.version_select at 0x7fae3393f3a0>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:53:51.270173 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-67335e57-4acf-434f-87b1-cd9cf8fff4ec tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/8ed9f915-3925-4176-bf07-80b780aa75c9" status: 200 len: 346 microversion: 2.1 time: 0.266055 Sep 16 01:53:51.271528 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 2/3] 10.222.0.42 () {58 vars in 1245 bytes} [Fri Sep 16 01:53:51 2022] GET /compute/v2.1/os-volumes/8ed9f915-3925-4176-bf07-80b780aa75c9 => generated 346 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:53:51.286599 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-f97da683-ea4d-4a54-bd0b-a20eb0916a5f tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] Action: 'create', calling method: .version_select at 0x7fae3397f280>, body: {"snapshot": {"volume_id": "8ed9f915-3925-4176-bf07-80b780aa75c9", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-188962626"}} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:53:51.718646 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-f97da683-ea4d-4a54-bd0b-a20eb0916a5f tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] 10.222.0.42 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.436292 Sep 16 01:53:51.720636 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 2/4] 10.222.0.42 () {60 vars in 1162 bytes} [Fri Sep 16 01:53:51 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:53:51.735554 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-464866bc-d969-4f43-8550-577241992d9c tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] Calling method '.version_select at 0x7fae3393fa60>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:53:51.892439 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-464866bc-d969-4f43-8550-577241992d9c tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/958f5e8c-dccc-4a36-b776-97ad839749e0" status: 200 len: 286 microversion: 2.1 time: 0.163008 Sep 16 01:53:51.893248 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 3/5] 10.222.0.42 () {58 vars in 1251 bytes} [Fri Sep 16 01:53:51 2022] GET /compute/v2.1/os-snapshots/958f5e8c-dccc-4a36-b776-97ad839749e0 => generated 286 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:53:51.909212 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-038c33fe-c46c-4bc9-93ab-14e68ac6b9b5 tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] Calling method '.version_select at 0x7fae33950160>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:53:52.013934 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-038c33fe-c46c-4bc9-93ab-14e68ac6b9b5 tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.113263 Sep 16 01:53:52.015388 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 3/6] 10.222.0.42 () {58 vars in 1140 bytes} [Fri Sep 16 01:53:51 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:53:52.028511 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-cf17e64f-7261-409d-8dac-7d6eb1a86c45 tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] Calling method '.version_select at 0x7fae338dc1f0>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:53:52.119623 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-cf17e64f-7261-409d-8dac-7d6eb1a86c45 tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/958f5e8c-dccc-4a36-b776-97ad839749e0" status: 200 len: 286 microversion: 2.1 time: 0.095219 Sep 16 01:53:52.120644 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 4/7] 10.222.0.42 () {58 vars in 1251 bytes} [Fri Sep 16 01:53:52 2022] GET /compute/v2.1/os-snapshots/958f5e8c-dccc-4a36-b776-97ad839749e0 => generated 286 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:53:53.137767 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-d8268a03-99d0-4464-a73e-f1472074ec56 tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] Calling method '.version_select at 0x7fae338d4550>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:53:53.426994 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-d8268a03-99d0-4464-a73e-f1472074ec56 tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/958f5e8c-dccc-4a36-b776-97ad839749e0" status: 200 len: 286 microversion: 2.1 time: 0.293315 Sep 16 01:53:53.427553 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 4/8] 10.222.0.42 () {58 vars in 1251 bytes} [Fri Sep 16 01:53:53 2022] GET /compute/v2.1/os-snapshots/958f5e8c-dccc-4a36-b776-97ad839749e0 => generated 286 bytes in 295 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:53:54.440381 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-14132d3e-47b3-4ae1-b7b5-4c2c3d94b433 tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] Calling method '.version_select at 0x7fae3393fb80>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:53:54.497809 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-14132d3e-47b3-4ae1-b7b5-4c2c3d94b433 tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/958f5e8c-dccc-4a36-b776-97ad839749e0" status: 200 len: 286 microversion: 2.1 time: 0.056096 Sep 16 01:53:54.497809 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 5/9] 10.222.0.42 () {58 vars in 1251 bytes} [Fri Sep 16 01:53:54 2022] GET /compute/v2.1/os-snapshots/958f5e8c-dccc-4a36-b776-97ad839749e0 => generated 286 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:53:55.511518 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-cf94dfb2-c34f-4b7a-9f1a-b93051f278e5 tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] Calling method '.version_select at 0x7fae33950790>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:53:55.572672 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-cf94dfb2-c34f-4b7a-9f1a-b93051f278e5 tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/958f5e8c-dccc-4a36-b776-97ad839749e0" status: 200 len: 286 microversion: 2.1 time: 0.066581 Sep 16 01:53:55.573239 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 5/10] 10.222.0.42 () {58 vars in 1251 bytes} [Fri Sep 16 01:53:55 2022] GET /compute/v2.1/os-snapshots/958f5e8c-dccc-4a36-b776-97ad839749e0 => generated 286 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:53:56.589051 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-665f9007-b6b5-49dd-9305-069da2e38d04 tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] Calling method '.version_select at 0x7fae3393f4c0>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:53:56.658562 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-665f9007-b6b5-49dd-9305-069da2e38d04 tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/958f5e8c-dccc-4a36-b776-97ad839749e0" status: 200 len: 286 microversion: 2.1 time: 0.076463 Sep 16 01:53:56.659906 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 6/11] 10.222.0.42 () {58 vars in 1251 bytes} [Fri Sep 16 01:53:56 2022] GET /compute/v2.1/os-snapshots/958f5e8c-dccc-4a36-b776-97ad839749e0 => generated 286 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:53:57.673715 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-326c5b96-8152-498e-89b2-4d4be847e98a tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] Calling method '.version_select at 0x7fae33950040>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:53:57.729947 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-326c5b96-8152-498e-89b2-4d4be847e98a tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/958f5e8c-dccc-4a36-b776-97ad839749e0" status: 200 len: 286 microversion: 2.1 time: 0.062380 Sep 16 01:53:57.731039 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 6/12] 10.222.0.42 () {58 vars in 1251 bytes} [Fri Sep 16 01:53:57 2022] GET /compute/v2.1/os-snapshots/958f5e8c-dccc-4a36-b776-97ad839749e0 => generated 286 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:53:58.749001 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-8d1a411e-c349-4984-8a7d-ab9d877f30f5 tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] Calling method '.version_select at 0x7fae338dc310>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:53:58.793363 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-8d1a411e-c349-4984-8a7d-ab9d877f30f5 tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/958f5e8c-dccc-4a36-b776-97ad839749e0" status: 200 len: 287 microversion: 2.1 time: 0.052235 Sep 16 01:53:58.795101 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 7/13] 10.222.0.42 () {58 vars in 1251 bytes} [Fri Sep 16 01:53:58 2022] GET /compute/v2.1/os-snapshots/958f5e8c-dccc-4a36-b776-97ad839749e0 => generated 287 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:53:58.821941 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-11f026c4-a8a6-42e2-bce1-d5edf13ec9ec tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] Calling method '.version_select at 0x7fae3429baf0>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:53:58.982819 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-11f026c4-a8a6-42e2-bce1-d5edf13ec9ec tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] 10.222.0.42 "DELETE /compute/v2.1/os-snapshots/958f5e8c-dccc-4a36-b776-97ad839749e0" status: 202 len: 0 microversion: 2.1 time: 0.179554 Sep 16 01:53:58.984168 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 7/14] 10.222.0.42 () {58 vars in 1254 bytes} [Fri Sep 16 01:53:58 2022] DELETE /compute/v2.1/os-snapshots/958f5e8c-dccc-4a36-b776-97ad839749e0 => generated 0 bytes in 182 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 01:53:58.993810 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-c8566f8b-e85a-4f5e-abb4-134208fb9628 tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] Calling method '.version_select at 0x7fae338dc8b0>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:53:59.081366 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-c8566f8b-e85a-4f5e-abb4-134208fb9628 tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/958f5e8c-dccc-4a36-b776-97ad839749e0" status: 200 len: 286 microversion: 2.1 time: 0.093032 Sep 16 01:53:59.083558 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 8/15] 10.222.0.42 () {58 vars in 1251 bytes} [Fri Sep 16 01:53:58 2022] GET /compute/v2.1/os-snapshots/958f5e8c-dccc-4a36-b776-97ad839749e0 => generated 286 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:53:59.411918 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-f3e48376-2ed9-4190-9264-6211d5c5ccc7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-2043349556", "imageRef": "1546da04-912c-44c6-b4b9-34fba35e08f6", "flavorRef": "452", "networks": [{"uuid": "7454b3cb-1a57-443a-9860-b924e28e0b99"}]}} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:53:59.610521 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.network.neutron [None req-f3e48376-2ed9-4190-9264-6211d5c5ccc7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] validate_networks() for [('7454b3cb-1a57-443a-9860-b924e28e0b99', None, None, None, None, None)] {{(pid=120440) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 01:54:00.095461 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-e0867722-e3c0-47fc-800a-4d30047dc988 tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] Calling method '.version_select at 0x7fae3393f3a0>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:00.177866 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-e0867722-e3c0-47fc-800a-4d30047dc988 tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/958f5e8c-dccc-4a36-b776-97ad839749e0" status: 200 len: 286 microversion: 2.1 time: 0.086786 Sep 16 01:54:00.179626 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 9/16] 10.222.0.42 () {58 vars in 1251 bytes} [Fri Sep 16 01:54:00 2022] GET /compute/v2.1/os-snapshots/958f5e8c-dccc-4a36-b776-97ad839749e0 => generated 286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 01:54:00.754825 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-9fc08e1e-6020-4b68-8620-ba28c8e8b355 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Action: 'create', calling method: .version_select at 0x7fae3393fc10>, body: {"keypair": {"name": "tempest-keypair-1924274324", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLdOUdvIQNcptS6R8MSnH+KbTg0pK7ZgkWvnlpu/BUTg57pniYcnzw1S84G2iyn/AZjcImdWyVAoWMp1IoksEnGSZ3If/BBw9JauuF2wiKMeJ4jwRBigkiFeyjNo2U5ajw=="}} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:54:00.906067 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.quota [None req-9fc08e1e-6020-4b68-8620-ba28c8e8b355 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Getting quotas for project 1377f60423c64a1786203deb55ae55ef. Resources: {'key_pairs'} {{(pid=120441) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 01:54:00.933816 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.quota [None req-9fc08e1e-6020-4b68-8620-ba28c8e8b355 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Getting quotas for user dd95ef263d15460f9cca5a7557cbee2e and project 1377f60423c64a1786203deb55ae55ef. Resources: {'key_pairs'} {{(pid=120441) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 01:54:01.025769 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-9fc08e1e-6020-4b68-8620-ba28c8e8b355 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.682074 Sep 16 01:54:01.027061 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 10/17] 10.222.0.42 () {62 vars in 1200 bytes} [Fri Sep 16 01:54:00 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 684 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 16 01:54:01.200942 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-56677017-8abf-456f-bf6e-c011c2fc34e8 tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] Calling method '.version_select at 0x7fae338b8af0>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:01.274929 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-56677017-8abf-456f-bf6e-c011c2fc34e8 tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/958f5e8c-dccc-4a36-b776-97ad839749e0" status: 200 len: 286 microversion: 2.1 time: 0.087606 Sep 16 01:54:01.277070 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 11/18] 10.222.0.42 () {58 vars in 1251 bytes} [Fri Sep 16 01:54:01 2022] GET /compute/v2.1/os-snapshots/958f5e8c-dccc-4a36-b776-97ad839749e0 => generated 286 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 01:54:01.637266 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.virt.hardware [None req-f3e48376-2ed9-4190-9264-6211d5c5ccc7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Flavor limits 0:0:0 {{(pid=120440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 01:54:01.637834 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.virt.hardware [None req-f3e48376-2ed9-4190-9264-6211d5c5ccc7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Image limits 0:0:0 {{(pid=120440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 01:54:01.638140 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.virt.hardware [None req-f3e48376-2ed9-4190-9264-6211d5c5ccc7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Flavor pref 0:0:0 {{(pid=120440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 01:54:01.638845 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.virt.hardware [None req-f3e48376-2ed9-4190-9264-6211d5c5ccc7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Image pref 0:0:0 {{(pid=120440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 01:54:01.639572 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.virt.hardware [None req-f3e48376-2ed9-4190-9264-6211d5c5ccc7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 01:54:01.659631 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-45f200d8-5425-48e5-8fec-82abe2924ee2 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Action: 'create', calling method: .version_select at 0x7fae338b88b0>, body: {"keypair": {"name": "tempest-keypair-1302709905", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBLVz5+IqLOluj7Yc1wc85UTI1NrHD78SS+EBq92yb68Ncuof7nN8IjF9GM7e5lK4trI8VdPq+Xk4G75OfRXE5ZSjAcTEuadU+c2sDucAYFfyQaEYL3Cn9HZJLE5sGKSrDA=="}} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:54:01.684708 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f3e48376-2ed9-4190-9264-6211d5c5ccc7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:01.685191 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f3e48376-2ed9-4190-9264-6211d5c5ccc7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:01.685797 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f3e48376-2ed9-4190-9264-6211d5c5ccc7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:01.686657 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f3e48376-2ed9-4190-9264-6211d5c5ccc7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:01.689063 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f3e48376-2ed9-4190-9264-6211d5c5ccc7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:01.689649 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f3e48376-2ed9-4190-9264-6211d5c5ccc7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:01.694865 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.quota [None req-45f200d8-5425-48e5-8fec-82abe2924ee2 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Getting quotas for project eddbb633debb4badb74f142d92baed98. Resources: {'key_pairs'} {{(pid=120441) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 01:54:01.702049 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.quota [None req-45f200d8-5425-48e5-8fec-82abe2924ee2 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Getting quotas for user 6fc9485505c443acb946ec66e0018f7b and project eddbb633debb4badb74f142d92baed98. Resources: {'key_pairs'} {{(pid=120441) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 01:54:01.744694 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-45f200d8-5425-48e5-8fec-82abe2924ee2 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.229089 Sep 16 01:54:01.751149 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 12/19] 10.222.0.42 () {60 vars in 1159 bytes} [Fri Sep 16 01:54:01 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:54:01.755650 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.quota [None req-f3e48376-2ed9-4190-9264-6211d5c5ccc7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Getting quotas for project 477dd0575c8741b0815ddf5f22297db3. Resources: {'cores', 'ram', 'instances'} {{(pid=120440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 01:54:01.795104 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.quota [None req-f3e48376-2ed9-4190-9264-6211d5c5ccc7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Getting quotas for user a39440ed016445a7bfc7ac7fba6661f2 and project 477dd0575c8741b0815ddf5f22297db3. Resources: {'cores', 'ram', 'instances'} {{(pid=120440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 01:54:01.833423 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-f3e48376-2ed9-4190-9264-6211d5c5ccc7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Going to run 1 instances... {{(pid=120440) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 01:54:01.847286 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-f3e48376-2ed9-4190-9264-6211d5c5ccc7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] [instance: 33b0ab06-b40e-4c13-a33f-cd6a2881fd16] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1546da04-912c-44c6-b4b9-34fba35e08f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 01:54:02.045185 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-f3e48376-2ed9-4190-9264-6211d5c5ccc7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.878606 Sep 16 01:54:02.046196 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 8/20] 10.222.0.42 () {60 vars in 1147 bytes} [Fri Sep 16 01:53:59 2022] POST /compute/v2.1/servers => generated 380 bytes in 2880 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 01:54:02.060151 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-e906b54a-ed44-495f-93f6-24153cb2b286 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:02.060934 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-e906b54a-ed44-495f-93f6-24153cb2b286 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] [instance: 33b0ab06-b40e-4c13-a33f-cd6a2881fd16] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:02.292343 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-6ef4701e-521d-478f-85b8-ad36fb4c8ce3 tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] Calling method '.version_select at 0x7fae32fe54c0>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:02.360819 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-e906b54a-ed44-495f-93f6-24153cb2b286 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a39440ed016445a7bfc7ac7fba6661f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477dd0575c8741b0815ddf5f22297db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:02.380982 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-6ef4701e-521d-478f-85b8-ad36fb4c8ce3 tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/958f5e8c-dccc-4a36-b776-97ad839749e0" status: 200 len: 286 microversion: 2.1 time: 0.094269 Sep 16 01:54:02.382296 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 9/21] 10.222.0.42 () {58 vars in 1251 bytes} [Fri Sep 16 01:54:02 2022] GET /compute/v2.1/os-snapshots/958f5e8c-dccc-4a36-b776-97ad839749e0 => generated 286 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:54:02.397443 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-e906b54a-ed44-495f-93f6-24153cb2b286 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] 10.222.0.42 "GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16" status: 200 len: 1215 microversion: 2.1 time: 0.339396 Sep 16 01:54:02.401854 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 13/22] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:02 2022] GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16 => generated 1215 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:03.396251 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-b3028d1c-acd3-4841-9d3c-f705032c12fb tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] Calling method '.version_select at 0x7fae32fe5c10>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:03.429773 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-bf5ada61-f45c-422c-86ad-ab77d506e81a tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:03.430512 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-bf5ada61-f45c-422c-86ad-ab77d506e81a tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] [instance: 33b0ab06-b40e-4c13-a33f-cd6a2881fd16] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:03.460214 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-b3028d1c-acd3-4841-9d3c-f705032c12fb tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/958f5e8c-dccc-4a36-b776-97ad839749e0" status: 200 len: 286 microversion: 2.1 time: 0.067655 Sep 16 01:54:03.461109 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 10/23] 10.222.0.42 () {58 vars in 1251 bytes} [Fri Sep 16 01:54:03 2022] GET /compute/v2.1/os-snapshots/958f5e8c-dccc-4a36-b776-97ad839749e0 => generated 286 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:54:03.980744 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-bf5ada61-f45c-422c-86ad-ab77d506e81a tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a39440ed016445a7bfc7ac7fba6661f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477dd0575c8741b0815ddf5f22297db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:03.987998 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-bf5ada61-f45c-422c-86ad-ab77d506e81a tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] 10.222.0.42 "GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16" status: 200 len: 1215 microversion: 2.1 time: 0.562222 Sep 16 01:54:03.988579 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 14/24] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:03 2022] GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16 => generated 1215 bytes in 563 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:04.474535 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-1c4117a1-263c-4e89-9798-5577aaa1db44 tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] Calling method '.version_select at 0x7fae32fe5af0>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:04.526420 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.wsgi [None req-1c4117a1-263c-4e89-9798-5577aaa1db44 tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] HTTP exception thrown: Snapshot 958f5e8c-dccc-4a36-b776-97ad839749e0 could not be found. Sep 16 01:54:04.530687 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-1c4117a1-263c-4e89-9798-5577aaa1db44 tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] Request method failure captured: Sep 16 01:54:04.530687 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: request: GET /compute/v2.1/os-snapshots/958f5e8c-dccc-4a36-b776-97ad839749e0 HTTP/1.1 Sep 16 01:54:04.530687 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept: application/json Sep 16 01:54:04.530687 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept-Encoding: identity Sep 16 01:54:04.530687 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Connection: close Sep 16 01:54:04.530687 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Length: 0 Sep 16 01:54:04.530687 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Type: application/json Sep 16 01:54:04.530687 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Host: 10.222.0.42 Sep 16 01:54:04.530687 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Openstack-System-Scope: None Sep 16 01:54:04.530687 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: User-Agent: python-urllib3/1.26.12 Sep 16 01:54:04.530687 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Auth-Token: gAAAAABjI9cpbcrcRqWggxrWlfdkD0LSvbZ7qcjDzffKE8hXQgRA5V23vYeSrZ5a8WVD7lZ9aNaOxrmKK7pxIH3qfRYgQ7Fp9ELC7Dbkn26tvgW-ZIdWCsTXg4Ix01hQShtgOMT-Uok7SHLmZclX9auxg4fU9wM40MUZ1QK8Digkwkf8rQmKwUs Sep 16 01:54:04.530687 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Id: None Sep 16 01:54:04.530687 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Name: None Sep 16 01:54:04.530687 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Identity-Status: Confirmed Sep 16 01:54:04.530687 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Is-Admin-Project: True Sep 16 01:54:04.530687 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Id: default Sep 16 01:54:04.530687 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Name: Default Sep 16 01:54:04.530687 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Id: 7b338918fdb447db92679939b9f534c4 Sep 16 01:54:04.530687 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1358436801 Sep 16 01:54:04.530687 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Role: member,reader Sep 16 01:54:04.530687 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Roles: member,reader Sep 16 01:54:04.531851 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7b338918fdb447db92679939b9f534c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7b338918fdb447db92679939b9f534c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7b338918fdb447db92679939b9f534c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7b338918fdb447db92679939b9f534c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 01:54:04.531851 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1358436801 Sep 16 01:54:04.531851 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Id: 7b338918fdb447db92679939b9f534c4 Sep 16 01:54:04.531851 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1358436801 Sep 16 01:54:04.531851 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User: tempest-VolumesSnapshotsTestJSON-1358436801-project Sep 16 01:54:04.531851 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Id: default Sep 16 01:54:04.531851 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Name: Default Sep 16 01:54:04.531851 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Id: 2bd4786e1b444c318436ead072ca2541 Sep 16 01:54:04.531851 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1358436801-project Sep 16 01:54:04.531851 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: method: Sep 16 01:54:04.531851 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: exception: Snapshot 958f5e8c-dccc-4a36-b776-97ad839749e0 could not be found. Sep 16 01:54:04.531851 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: action_args: {'id': '958f5e8c-dccc-4a36-b776-97ad839749e0'} Sep 16 01:54:04.531851 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 01:54:04.532779 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:54:04.532779 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 16 01:54:04.532779 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 16 01:54:04.532779 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 16 01:54:04.532779 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 16 01:54:04.532779 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 16 01:54:04.532779 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 16 01:54:04.532779 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 16 01:54:04.532779 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 16 01:54:04.532779 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 16 01:54:04.532779 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 16 01:54:04.532779 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 01:54:04.532779 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 01:54:04.532779 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 01:54:04.532779 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 01:54:04.532779 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 958f5e8c-dccc-4a36-b776-97ad839749e0 could not be found. (HTTP 404) (Request-ID: req-993ce5e4-1da9-48b3-8d1f-62e03791039f) Sep 16 01:54:04.532779 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 01:54:04.532779 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:54:04.533770 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 01:54:04.533770 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:54:04.533770 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 16 01:54:04.533770 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 16 01:54:04.533770 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 16 01:54:04.533770 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 16 01:54:04.533770 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 16 01:54:04.533770 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 16 01:54:04.533770 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 16 01:54:04.533770 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 16 01:54:04.533770 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 16 01:54:04.533770 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 16 01:54:04.533770 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 16 01:54:04.533770 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 16 01:54:04.533770 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 16 01:54:04.533770 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 16 01:54:04.533770 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 16 01:54:04.533770 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 16 01:54:04.533770 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 16 01:54:04.534645 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 16 01:54:04.534645 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 01:54:04.534645 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 01:54:04.534645 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 01:54:04.534645 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 01:54:04.534645 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 958f5e8c-dccc-4a36-b776-97ad839749e0 could not be found. Sep 16 01:54:04.534645 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 01:54:04.534645 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:54:04.534645 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 01:54:04.534645 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:54:04.534645 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 01:54:04.534645 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 01:54:04.534645 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 01:54:04.534645 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 01:54:04.534645 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 01:54:04.534645 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 01:54:04.534645 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 01:54:04.534645 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 01:54:04.534645 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 16 01:54:04.534645 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 01:54:04.538042 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 958f5e8c-dccc-4a36-b776-97ad839749e0 could not be found. Sep 16 01:54:04.538042 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 01:54:04.538042 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:54:04.538042 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 01:54:04.538042 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:54:04.538042 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 01:54:04.538042 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 01:54:04.538042 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 01:54:04.538042 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 01:54:04.538042 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 958f5e8c-dccc-4a36-b776-97ad839749e0 could not be found. Sep 16 01:54:04.538042 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 01:54:04.538042 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-1c4117a1-263c-4e89-9798-5577aaa1db44 tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] Returning 404 to user: Snapshot 958f5e8c-dccc-4a36-b776-97ad839749e0 could not be found. {{(pid=120440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 01:54:04.538042 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-1c4117a1-263c-4e89-9798-5577aaa1db44 tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] 10.222.0.42 "GET /compute/v2.1/os-snapshots/958f5e8c-dccc-4a36-b776-97ad839749e0" status: 404 len: 111 microversion: 2.1 time: 0.062367 Sep 16 01:54:04.538920 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 11/25] 10.222.0.42 () {58 vars in 1251 bytes} [Fri Sep 16 01:54:04 2022] GET /compute/v2.1/os-snapshots/958f5e8c-dccc-4a36-b776-97ad839749e0 => generated 111 bytes in 63 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 01:54:04.541526 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-8b490d75-4580-4b83-beb1-79f640e8e71f tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] Calling method '.version_select at 0x7fae3382c670>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:04.672978 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-8b490d75-4580-4b83-beb1-79f640e8e71f tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/8ed9f915-3925-4176-bf07-80b780aa75c9" status: 202 len: 0 microversion: 2.1 time: 0.135600 Sep 16 01:54:04.674361 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 15/26] 10.222.0.42 () {58 vars in 1248 bytes} [Fri Sep 16 01:54:04 2022] DELETE /compute/v2.1/os-volumes/8ed9f915-3925-4176-bf07-80b780aa75c9 => generated 0 bytes in 137 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 01:54:04.689152 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-821d9642-ad16-4135-97a7-9698c913191e tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] Calling method '.version_select at 0x7fae3429ba60>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:04.822763 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-821d9642-ad16-4135-97a7-9698c913191e tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/8ed9f915-3925-4176-bf07-80b780aa75c9" status: 200 len: 345 microversion: 2.1 time: 0.143483 Sep 16 01:54:04.825280 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 12/27] 10.222.0.42 () {58 vars in 1245 bytes} [Fri Sep 16 01:54:04 2022] GET /compute/v2.1/os-volumes/8ed9f915-3925-4176-bf07-80b780aa75c9 => generated 345 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:54:05.016175 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-921eec72-e902-4918-8d51-0a0b0d93b21d tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:05.018203 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-921eec72-e902-4918-8d51-0a0b0d93b21d tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] [instance: 33b0ab06-b40e-4c13-a33f-cd6a2881fd16] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:05.048832 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-921eec72-e902-4918-8d51-0a0b0d93b21d tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:05.049421 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-921eec72-e902-4918-8d51-0a0b0d93b21d tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:05.054778 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-921eec72-e902-4918-8d51-0a0b0d93b21d tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:05.055844 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-921eec72-e902-4918-8d51-0a0b0d93b21d tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:05.060223 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-921eec72-e902-4918-8d51-0a0b0d93b21d tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:05.061812 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-921eec72-e902-4918-8d51-0a0b0d93b21d tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:05.562603 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-921eec72-e902-4918-8d51-0a0b0d93b21d tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a39440ed016445a7bfc7ac7fba6661f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477dd0575c8741b0815ddf5f22297db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:05.583401 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-921eec72-e902-4918-8d51-0a0b0d93b21d tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] 10.222.0.42 "GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16" status: 200 len: 1267 microversion: 2.1 time: 0.576298 Sep 16 01:54:05.591068 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 16/28] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:05 2022] GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16 => generated 1267 bytes in 585 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:05.838978 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-d39d2170-e01c-4677-a768-1bc59ae02cd2 tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] Calling method '.version_select at 0x7fae32fe5a60>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:05.901818 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.wsgi [None req-d39d2170-e01c-4677-a768-1bc59ae02cd2 tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] HTTP exception thrown: Volume 8ed9f915-3925-4176-bf07-80b780aa75c9 could not be found. Sep 16 01:54:05.905050 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-d39d2170-e01c-4677-a768-1bc59ae02cd2 tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] Request method failure captured: Sep 16 01:54:05.905050 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: request: GET /compute/v2.1/os-volumes/8ed9f915-3925-4176-bf07-80b780aa75c9 HTTP/1.1 Sep 16 01:54:05.905050 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept: application/json Sep 16 01:54:05.905050 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept-Encoding: identity Sep 16 01:54:05.905050 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Connection: close Sep 16 01:54:05.905050 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Length: 0 Sep 16 01:54:05.905050 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Type: application/json Sep 16 01:54:05.905050 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Host: 10.222.0.42 Sep 16 01:54:05.905050 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Openstack-System-Scope: None Sep 16 01:54:05.905050 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: User-Agent: python-urllib3/1.26.12 Sep 16 01:54:05.905050 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Auth-Token: gAAAAABjI9cpbcrcRqWggxrWlfdkD0LSvbZ7qcjDzffKE8hXQgRA5V23vYeSrZ5a8WVD7lZ9aNaOxrmKK7pxIH3qfRYgQ7Fp9ELC7Dbkn26tvgW-ZIdWCsTXg4Ix01hQShtgOMT-Uok7SHLmZclX9auxg4fU9wM40MUZ1QK8Digkwkf8rQmKwUs Sep 16 01:54:05.905050 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Id: None Sep 16 01:54:05.905050 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Name: None Sep 16 01:54:05.905050 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Identity-Status: Confirmed Sep 16 01:54:05.905050 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Is-Admin-Project: True Sep 16 01:54:05.905050 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Id: default Sep 16 01:54:05.905050 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Name: Default Sep 16 01:54:05.905050 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Id: 7b338918fdb447db92679939b9f534c4 Sep 16 01:54:05.905050 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1358436801 Sep 16 01:54:05.905050 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Role: member,reader Sep 16 01:54:05.905050 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Roles: member,reader Sep 16 01:54:05.906360 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7b338918fdb447db92679939b9f534c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7b338918fdb447db92679939b9f534c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7b338918fdb447db92679939b9f534c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7b338918fdb447db92679939b9f534c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 01:54:05.906360 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1358436801 Sep 16 01:54:05.906360 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Id: 7b338918fdb447db92679939b9f534c4 Sep 16 01:54:05.906360 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1358436801 Sep 16 01:54:05.906360 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User: tempest-VolumesSnapshotsTestJSON-1358436801-project Sep 16 01:54:05.906360 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Id: default Sep 16 01:54:05.906360 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Name: Default Sep 16 01:54:05.906360 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Id: 2bd4786e1b444c318436ead072ca2541 Sep 16 01:54:05.906360 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1358436801-project Sep 16 01:54:05.906360 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: method: Sep 16 01:54:05.906360 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: exception: Volume 8ed9f915-3925-4176-bf07-80b780aa75c9 could not be found. Sep 16 01:54:05.906360 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: action_args: {'id': '8ed9f915-3925-4176-bf07-80b780aa75c9'} Sep 16 01:54:05.906360 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 01:54:05.907288 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:54:05.907288 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 01:54:05.907288 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 01:54:05.907288 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 16 01:54:05.907288 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 16 01:54:05.907288 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 16 01:54:05.907288 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 16 01:54:05.907288 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 16 01:54:05.907288 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 16 01:54:05.907288 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 16 01:54:05.907288 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 16 01:54:05.907288 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 01:54:05.907288 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 01:54:05.907288 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 01:54:05.907288 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 01:54:05.907288 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8ed9f915-3925-4176-bf07-80b780aa75c9 could not be found. (HTTP 404) (Request-ID: req-2a452aba-7487-4a3f-878d-35960c514c6d) Sep 16 01:54:05.907288 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 01:54:05.907288 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:54:05.907288 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 01:54:05.908455 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:54:05.908455 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 16 01:54:05.908455 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 16 01:54:05.908455 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 16 01:54:05.908455 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 16 01:54:05.908455 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 16 01:54:05.908455 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 16 01:54:05.908455 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 16 01:54:05.908455 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 16 01:54:05.908455 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 01:54:05.908455 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 01:54:05.908455 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 16 01:54:05.908455 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 16 01:54:05.908455 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 16 01:54:05.908455 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 16 01:54:05.908455 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 16 01:54:05.908455 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 16 01:54:05.908455 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 16 01:54:05.908455 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 16 01:54:05.909562 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 01:54:05.909562 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 01:54:05.909562 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 01:54:05.909562 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 01:54:05.909562 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8ed9f915-3925-4176-bf07-80b780aa75c9 could not be found. Sep 16 01:54:05.909562 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 01:54:05.909562 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:54:05.909562 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 01:54:05.909562 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:54:05.909562 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 01:54:05.909562 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 01:54:05.909562 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 01:54:05.909562 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 01:54:05.909562 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 01:54:05.909562 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 01:54:05.909562 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 01:54:05.909562 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 01:54:05.909562 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 16 01:54:05.909562 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 01:54:05.910649 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8ed9f915-3925-4176-bf07-80b780aa75c9 could not be found. Sep 16 01:54:05.910649 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 01:54:05.910649 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:54:05.910649 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 01:54:05.910649 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:54:05.910649 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 01:54:05.910649 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 01:54:05.910649 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 01:54:05.910649 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 01:54:05.910649 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8ed9f915-3925-4176-bf07-80b780aa75c9 could not be found. Sep 16 01:54:05.910649 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 01:54:05.912410 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-d39d2170-e01c-4677-a768-1bc59ae02cd2 tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] Returning 404 to user: Volume 8ed9f915-3925-4176-bf07-80b780aa75c9 could not be found. {{(pid=120440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 01:54:05.915215 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-d39d2170-e01c-4677-a768-1bc59ae02cd2 tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/8ed9f915-3925-4176-bf07-80b780aa75c9" status: 404 len: 109 microversion: 2.1 time: 0.078648 Sep 16 01:54:05.916354 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 13/29] 10.222.0.42 () {58 vars in 1245 bytes} [Fri Sep 16 01:54:05 2022] GET /compute/v2.1/os-volumes/8ed9f915-3925-4176-bf07-80b780aa75c9 => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 01:54:05.926734 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-5443716e-3998-435b-b03a-7bc740bb641b tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] Calling method '.version_select at 0x7fae337b4f70>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:06.002428 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.wsgi [None req-5443716e-3998-435b-b03a-7bc740bb641b tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] HTTP exception thrown: Volume 8ed9f915-3925-4176-bf07-80b780aa75c9 could not be found. Sep 16 01:54:06.009258 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-5443716e-3998-435b-b03a-7bc740bb641b tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] Request method failure captured: Sep 16 01:54:06.009258 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: request: DELETE /compute/v2.1/os-volumes/8ed9f915-3925-4176-bf07-80b780aa75c9 HTTP/1.1 Sep 16 01:54:06.009258 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Accept: application/json Sep 16 01:54:06.009258 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Accept-Encoding: identity Sep 16 01:54:06.009258 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Connection: close Sep 16 01:54:06.009258 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Content-Length: 0 Sep 16 01:54:06.009258 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Content-Type: application/json Sep 16 01:54:06.009258 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Host: 10.222.0.42 Sep 16 01:54:06.009258 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Openstack-System-Scope: None Sep 16 01:54:06.009258 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: User-Agent: python-urllib3/1.26.12 Sep 16 01:54:06.009258 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Auth-Token: gAAAAABjI9cpbcrcRqWggxrWlfdkD0LSvbZ7qcjDzffKE8hXQgRA5V23vYeSrZ5a8WVD7lZ9aNaOxrmKK7pxIH3qfRYgQ7Fp9ELC7Dbkn26tvgW-ZIdWCsTXg4Ix01hQShtgOMT-Uok7SHLmZclX9auxg4fU9wM40MUZ1QK8Digkwkf8rQmKwUs Sep 16 01:54:06.009258 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Domain-Id: None Sep 16 01:54:06.009258 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Domain-Name: None Sep 16 01:54:06.009258 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Identity-Status: Confirmed Sep 16 01:54:06.009258 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Is-Admin-Project: True Sep 16 01:54:06.009258 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Domain-Id: default Sep 16 01:54:06.009258 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Domain-Name: Default Sep 16 01:54:06.009258 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Id: 7b338918fdb447db92679939b9f534c4 Sep 16 01:54:06.009258 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1358436801 Sep 16 01:54:06.009258 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Role: member,reader Sep 16 01:54:06.009258 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Roles: member,reader Sep 16 01:54:06.010571 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7b338918fdb447db92679939b9f534c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7b338918fdb447db92679939b9f534c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7b338918fdb447db92679939b9f534c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7b338918fdb447db92679939b9f534c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 01:54:06.010571 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1358436801 Sep 16 01:54:06.010571 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant-Id: 7b338918fdb447db92679939b9f534c4 Sep 16 01:54:06.010571 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1358436801 Sep 16 01:54:06.010571 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User: tempest-VolumesSnapshotsTestJSON-1358436801-project Sep 16 01:54:06.010571 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Domain-Id: default Sep 16 01:54:06.010571 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Domain-Name: Default Sep 16 01:54:06.010571 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Id: 2bd4786e1b444c318436ead072ca2541 Sep 16 01:54:06.010571 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1358436801-project Sep 16 01:54:06.010571 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: method: Sep 16 01:54:06.010571 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: exception: Volume 8ed9f915-3925-4176-bf07-80b780aa75c9 could not be found. Sep 16 01:54:06.010571 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: action_args: {'id': '8ed9f915-3925-4176-bf07-80b780aa75c9'} Sep 16 01:54:06.010571 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 01:54:06.011265 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:54:06.011265 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 01:54:06.011265 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 01:54:06.011265 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 16 01:54:06.011265 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 16 01:54:06.011265 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 16 01:54:06.011265 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 16 01:54:06.011265 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 16 01:54:06.011265 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 16 01:54:06.011265 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 16 01:54:06.011265 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 16 01:54:06.011265 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 01:54:06.011265 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 01:54:06.011265 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 01:54:06.011265 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 01:54:06.011265 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8ed9f915-3925-4176-bf07-80b780aa75c9 could not be found. (HTTP 404) (Request-ID: req-9a1395c2-015d-453e-a642-2cc5e66335f9) Sep 16 01:54:06.011265 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:54:06.011265 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:54:06.011265 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:54:06.012403 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:54:06.012403 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 16 01:54:06.012403 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 16 01:54:06.012403 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 16 01:54:06.012403 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 16 01:54:06.012403 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 16 01:54:06.012403 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 16 01:54:06.012403 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 16 01:54:06.012403 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 16 01:54:06.012403 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 01:54:06.012403 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 01:54:06.012403 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 16 01:54:06.012403 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 16 01:54:06.012403 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 16 01:54:06.012403 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 16 01:54:06.012403 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 16 01:54:06.012403 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 16 01:54:06.012403 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 16 01:54:06.012403 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 16 01:54:06.013687 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 01:54:06.013687 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 01:54:06.013687 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 01:54:06.013687 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 01:54:06.013687 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8ed9f915-3925-4176-bf07-80b780aa75c9 could not be found. Sep 16 01:54:06.013687 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:54:06.013687 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:54:06.013687 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:54:06.013687 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:54:06.013687 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 01:54:06.013687 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 01:54:06.013687 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 01:54:06.013687 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 01:54:06.013687 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 01:54:06.013687 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 01:54:06.013687 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 01:54:06.013687 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 01:54:06.013687 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 16 01:54:06.013687 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 01:54:06.014830 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8ed9f915-3925-4176-bf07-80b780aa75c9 could not be found. Sep 16 01:54:06.014830 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:54:06.014830 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:54:06.014830 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:54:06.014830 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:54:06.014830 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 01:54:06.014830 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 01:54:06.014830 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 01:54:06.014830 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 01:54:06.014830 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8ed9f915-3925-4176-bf07-80b780aa75c9 could not be found. Sep 16 01:54:06.014830 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:54:06.016773 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-5443716e-3998-435b-b03a-7bc740bb641b tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] Returning 404 to user: Volume 8ed9f915-3925-4176-bf07-80b780aa75c9 could not be found. {{(pid=120441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 01:54:06.017477 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-5443716e-3998-435b-b03a-7bc740bb641b tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/8ed9f915-3925-4176-bf07-80b780aa75c9" status: 404 len: 109 microversion: 2.1 time: 0.095045 Sep 16 01:54:06.020652 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 17/30] 10.222.0.42 () {58 vars in 1248 bytes} [Fri Sep 16 01:54:05 2022] DELETE /compute/v2.1/os-volumes/8ed9f915-3925-4176-bf07-80b780aa75c9 => generated 109 bytes in 99 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 01:54:06.031552 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-04537c1f-6a67-4a7f-b381-062425ad3183 tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] Calling method '.version_select at 0x7fae32fcfb80>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:06.090419 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.wsgi [None req-04537c1f-6a67-4a7f-b381-062425ad3183 tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] HTTP exception thrown: Volume 8ed9f915-3925-4176-bf07-80b780aa75c9 could not be found. Sep 16 01:54:06.092835 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-04537c1f-6a67-4a7f-b381-062425ad3183 tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] Request method failure captured: Sep 16 01:54:06.092835 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: request: GET /compute/v2.1/os-volumes/8ed9f915-3925-4176-bf07-80b780aa75c9 HTTP/1.1 Sep 16 01:54:06.092835 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept: application/json Sep 16 01:54:06.092835 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept-Encoding: identity Sep 16 01:54:06.092835 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Connection: close Sep 16 01:54:06.092835 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Length: 0 Sep 16 01:54:06.092835 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Type: application/json Sep 16 01:54:06.092835 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Host: 10.222.0.42 Sep 16 01:54:06.092835 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Openstack-System-Scope: None Sep 16 01:54:06.092835 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: User-Agent: python-urllib3/1.26.12 Sep 16 01:54:06.092835 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Auth-Token: gAAAAABjI9cpbcrcRqWggxrWlfdkD0LSvbZ7qcjDzffKE8hXQgRA5V23vYeSrZ5a8WVD7lZ9aNaOxrmKK7pxIH3qfRYgQ7Fp9ELC7Dbkn26tvgW-ZIdWCsTXg4Ix01hQShtgOMT-Uok7SHLmZclX9auxg4fU9wM40MUZ1QK8Digkwkf8rQmKwUs Sep 16 01:54:06.092835 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Id: None Sep 16 01:54:06.092835 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Name: None Sep 16 01:54:06.092835 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Identity-Status: Confirmed Sep 16 01:54:06.092835 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Is-Admin-Project: True Sep 16 01:54:06.092835 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Id: default Sep 16 01:54:06.092835 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Name: Default Sep 16 01:54:06.092835 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Id: 7b338918fdb447db92679939b9f534c4 Sep 16 01:54:06.092835 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1358436801 Sep 16 01:54:06.092835 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Role: member,reader Sep 16 01:54:06.092835 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Roles: member,reader Sep 16 01:54:06.093921 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7b338918fdb447db92679939b9f534c4"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7b338918fdb447db92679939b9f534c4"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7b338918fdb447db92679939b9f534c4"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7b338918fdb447db92679939b9f534c4"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 01:54:06.093921 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1358436801 Sep 16 01:54:06.093921 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Id: 7b338918fdb447db92679939b9f534c4 Sep 16 01:54:06.093921 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1358436801 Sep 16 01:54:06.093921 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User: tempest-VolumesSnapshotsTestJSON-1358436801-project Sep 16 01:54:06.093921 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Id: default Sep 16 01:54:06.093921 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Name: Default Sep 16 01:54:06.093921 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Id: 2bd4786e1b444c318436ead072ca2541 Sep 16 01:54:06.093921 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1358436801-project Sep 16 01:54:06.093921 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: method: Sep 16 01:54:06.093921 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: exception: Volume 8ed9f915-3925-4176-bf07-80b780aa75c9 could not be found. Sep 16 01:54:06.093921 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: action_args: {'id': '8ed9f915-3925-4176-bf07-80b780aa75c9'} Sep 16 01:54:06.093921 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 01:54:06.094551 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:54:06.094551 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 01:54:06.094551 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 01:54:06.094551 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 16 01:54:06.094551 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 16 01:54:06.094551 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 16 01:54:06.094551 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 16 01:54:06.094551 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 16 01:54:06.094551 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 16 01:54:06.094551 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 16 01:54:06.094551 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 16 01:54:06.094551 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 01:54:06.094551 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 01:54:06.094551 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 01:54:06.094551 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 01:54:06.094551 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 8ed9f915-3925-4176-bf07-80b780aa75c9 could not be found. (HTTP 404) (Request-ID: req-be2383cd-1661-4bc3-b2e7-c23af9223cbe) Sep 16 01:54:06.094551 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 01:54:06.094551 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:54:06.094551 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 01:54:06.095509 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:54:06.095509 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 16 01:54:06.095509 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 16 01:54:06.095509 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 16 01:54:06.095509 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 16 01:54:06.095509 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 16 01:54:06.095509 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 16 01:54:06.095509 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 16 01:54:06.095509 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 16 01:54:06.095509 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 01:54:06.095509 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 01:54:06.095509 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 16 01:54:06.095509 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 16 01:54:06.095509 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 16 01:54:06.095509 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 16 01:54:06.095509 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 16 01:54:06.095509 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 16 01:54:06.095509 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 16 01:54:06.095509 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 16 01:54:06.096458 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 01:54:06.096458 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 01:54:06.096458 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 01:54:06.096458 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 01:54:06.096458 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 8ed9f915-3925-4176-bf07-80b780aa75c9 could not be found. Sep 16 01:54:06.096458 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 01:54:06.096458 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:54:06.096458 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 01:54:06.096458 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:54:06.096458 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 01:54:06.096458 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 01:54:06.096458 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 01:54:06.096458 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 01:54:06.096458 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 01:54:06.096458 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 01:54:06.096458 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 01:54:06.096458 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 01:54:06.096458 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 16 01:54:06.096458 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 01:54:06.098160 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 8ed9f915-3925-4176-bf07-80b780aa75c9 could not be found. Sep 16 01:54:06.098160 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 01:54:06.098160 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:54:06.098160 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 01:54:06.098160 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:54:06.098160 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 01:54:06.098160 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 01:54:06.098160 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 01:54:06.098160 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 01:54:06.098160 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 8ed9f915-3925-4176-bf07-80b780aa75c9 could not be found. Sep 16 01:54:06.098160 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 01:54:06.098160 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-04537c1f-6a67-4a7f-b381-062425ad3183 tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] Returning 404 to user: Volume 8ed9f915-3925-4176-bf07-80b780aa75c9 could not be found. {{(pid=120440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 01:54:06.098160 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-04537c1f-6a67-4a7f-b381-062425ad3183 tempest-VolumesSnapshotsTestJSON-1358436801 tempest-VolumesSnapshotsTestJSON-1358436801-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/8ed9f915-3925-4176-bf07-80b780aa75c9" status: 404 len: 109 microversion: 2.1 time: 0.068851 Sep 16 01:54:06.098160 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 14/31] 10.222.0.42 () {58 vars in 1245 bytes} [Fri Sep 16 01:54:06 2022] GET /compute/v2.1/os-volumes/8ed9f915-3925-4176-bf07-80b780aa75c9 => generated 109 bytes in 70 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 01:54:06.626091 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-05053017-543f-4999-9690-5418a4e7d3f2 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:06.627650 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-05053017-543f-4999-9690-5418a4e7d3f2 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] [instance: 33b0ab06-b40e-4c13-a33f-cd6a2881fd16] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:06.648465 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-d3822a92-4ee5-4035-be4f-37a4103dc956 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1835920830", "imageRef": "1546da04-912c-44c6-b4b9-34fba35e08f6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "37ec5744-bfab-42fe-b2e4-a18259c0344e"}], "security_groups": [{"name": "tempest-securitygroup--1014129796"}], "key_name": "tempest-keypair-1924274324", "user_data": "}} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:54:06.668933 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-05053017-543f-4999-9690-5418a4e7d3f2 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:06.680798 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-05053017-543f-4999-9690-5418a4e7d3f2 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:06.684460 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-05053017-543f-4999-9690-5418a4e7d3f2 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:06.689588 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-05053017-543f-4999-9690-5418a4e7d3f2 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:06.690423 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-05053017-543f-4999-9690-5418a4e7d3f2 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:06.693995 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-05053017-543f-4999-9690-5418a4e7d3f2 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:06.889758 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-05053017-543f-4999-9690-5418a4e7d3f2 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a39440ed016445a7bfc7ac7fba6661f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477dd0575c8741b0815ddf5f22297db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:06.898042 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-05053017-543f-4999-9690-5418a4e7d3f2 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] 10.222.0.42 "GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16" status: 200 len: 1273 microversion: 2.1 time: 0.278588 Sep 16 01:54:06.904227 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 18/32] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:06 2022] GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16 => generated 1273 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:07.211524 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.network.neutron [None req-d3822a92-4ee5-4035-be4f-37a4103dc956 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] validate_networks() for [('37ec5744-bfab-42fe-b2e4-a18259c0344e', None, None, None, None, None)] {{(pid=120440) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 01:54:07.240973 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-98634c41-3c54-4aaa-9828-697c5816e56b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1011526117", "imageRef": "1546da04-912c-44c6-b4b9-34fba35e08f6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "563a693f-c940-49d3-9204-92b27430de2f"}], "security_groups": [{"name": "tempest-securitygroup--1759628038"}], "key_name": "tempest-keypair-1302709905", "user_data": "}} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:54:07.549302 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.network.neutron [None req-98634c41-3c54-4aaa-9828-697c5816e56b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] validate_networks() for [('563a693f-c940-49d3-9204-92b27430de2f', None, None, None, None, None)] {{(pid=120441) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 01:54:09.887023 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.virt.hardware [None req-d3822a92-4ee5-4035-be4f-37a4103dc956 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Flavor limits 0:0:0 {{(pid=120440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 01:54:09.887718 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.virt.hardware [None req-d3822a92-4ee5-4035-be4f-37a4103dc956 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Image limits 0:0:0 {{(pid=120440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 01:54:09.888132 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.virt.hardware [None req-d3822a92-4ee5-4035-be4f-37a4103dc956 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Flavor pref 0:0:0 {{(pid=120440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 01:54:09.888544 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.virt.hardware [None req-d3822a92-4ee5-4035-be4f-37a4103dc956 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Image pref 0:0:0 {{(pid=120440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 01:54:09.889046 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.virt.hardware [None req-d3822a92-4ee5-4035-be4f-37a4103dc956 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 01:54:09.909909 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d3822a92-4ee5-4035-be4f-37a4103dc956 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:09.914623 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d3822a92-4ee5-4035-be4f-37a4103dc956 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:09.917326 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d3822a92-4ee5-4035-be4f-37a4103dc956 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:09.921818 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d3822a92-4ee5-4035-be4f-37a4103dc956 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:09.926286 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d3822a92-4ee5-4035-be4f-37a4103dc956 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:09.934483 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d3822a92-4ee5-4035-be4f-37a4103dc956 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:10.040134 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.quota [None req-d3822a92-4ee5-4035-be4f-37a4103dc956 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Getting quotas for project 1377f60423c64a1786203deb55ae55ef. Resources: {'cores', 'ram', 'instances'} {{(pid=120440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 01:54:10.058979 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.quota [None req-d3822a92-4ee5-4035-be4f-37a4103dc956 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Getting quotas for user dd95ef263d15460f9cca5a7557cbee2e and project 1377f60423c64a1786203deb55ae55ef. Resources: {'cores', 'ram', 'instances'} {{(pid=120440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 01:54:10.086056 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-d3822a92-4ee5-4035-be4f-37a4103dc956 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Going to run 1 instances... {{(pid=120440) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 01:54:10.089054 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-d3822a92-4ee5-4035-be4f-37a4103dc956 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1546da04-912c-44c6-b4b9-34fba35e08f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 01:54:10.201605 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-d3822a92-4ee5-4035-be4f-37a4103dc956 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 3.557151 Sep 16 01:54:10.216444 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 15/33] 10.222.0.42 () {62 vars in 1188 bytes} [Fri Sep 16 01:54:06 2022] POST /compute/v2.1/servers => generated 402 bytes in 3567 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 16 01:54:10.967291 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.virt.hardware [None req-98634c41-3c54-4aaa-9828-697c5816e56b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Flavor limits 0:0:0 {{(pid=120441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 01:54:10.968083 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.virt.hardware [None req-98634c41-3c54-4aaa-9828-697c5816e56b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Image limits 0:0:0 {{(pid=120441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 01:54:10.969199 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.virt.hardware [None req-98634c41-3c54-4aaa-9828-697c5816e56b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Flavor pref 0:0:0 {{(pid=120441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 01:54:10.973794 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.virt.hardware [None req-98634c41-3c54-4aaa-9828-697c5816e56b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Image pref 0:0:0 {{(pid=120441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 01:54:10.974342 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.virt.hardware [None req-98634c41-3c54-4aaa-9828-697c5816e56b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 01:54:11.014627 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-98634c41-3c54-4aaa-9828-697c5816e56b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:11.015663 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-98634c41-3c54-4aaa-9828-697c5816e56b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:11.019852 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-98634c41-3c54-4aaa-9828-697c5816e56b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:11.028713 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-98634c41-3c54-4aaa-9828-697c5816e56b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:11.032172 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-98634c41-3c54-4aaa-9828-697c5816e56b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:11.032934 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-98634c41-3c54-4aaa-9828-697c5816e56b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:11.146026 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-546d24c3-952d-4720-b557-96a41c7cfbd0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1951403611", "imageRef": "1546da04-912c-44c6-b4b9-34fba35e08f6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:54:11.176925 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.quota [None req-98634c41-3c54-4aaa-9828-697c5816e56b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Getting quotas for project eddbb633debb4badb74f142d92baed98. Resources: {'cores', 'ram', 'instances'} {{(pid=120441) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 01:54:11.211017 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.quota [None req-98634c41-3c54-4aaa-9828-697c5816e56b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Getting quotas for user 6fc9485505c443acb946ec66e0018f7b and project eddbb633debb4badb74f142d92baed98. Resources: {'cores', 'ram', 'instances'} {{(pid=120441) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 01:54:11.254273 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-98634c41-3c54-4aaa-9828-697c5816e56b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Going to run 1 instances... {{(pid=120441) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 01:54:11.258370 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-98634c41-3c54-4aaa-9828-697c5816e56b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1546da04-912c-44c6-b4b9-34fba35e08f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120441) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 01:54:11.387565 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.network.neutron [None req-546d24c3-952d-4720-b557-96a41c7cfbd0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] validate_networks() for [('992cb23b-f0e5-4bb7-a3b2-f0f9634fe190', None, None, None, None, None)] {{(pid=120440) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 01:54:11.514687 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-98634c41-3c54-4aaa-9828-697c5816e56b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 4.278213 Sep 16 01:54:11.515322 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 19/34] 10.222.0.42 () {60 vars in 1147 bytes} [Fri Sep 16 01:54:07 2022] POST /compute/v2.1/servers => generated 402 bytes in 4280 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 16 01:54:11.549795 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-8c913a64-99d7-44bd-ac39-7a4fc4a6569b tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:11.550765 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-8c913a64-99d7-44bd-ac39-7a4fc4a6569b tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] [instance: 33b0ab06-b40e-4c13-a33f-cd6a2881fd16] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:11.578953 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8c913a64-99d7-44bd-ac39-7a4fc4a6569b tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:11.579337 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8c913a64-99d7-44bd-ac39-7a4fc4a6569b tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:11.579777 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8c913a64-99d7-44bd-ac39-7a4fc4a6569b tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:11.580647 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8c913a64-99d7-44bd-ac39-7a4fc4a6569b tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:11.580947 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8c913a64-99d7-44bd-ac39-7a4fc4a6569b tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:11.592781 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8c913a64-99d7-44bd-ac39-7a4fc4a6569b tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:12.447029 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-8c913a64-99d7-44bd-ac39-7a4fc4a6569b tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a39440ed016445a7bfc7ac7fba6661f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477dd0575c8741b0815ddf5f22297db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:12.481027 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-8c913a64-99d7-44bd-ac39-7a4fc4a6569b tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] 10.222.0.42 "GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16" status: 200 len: 1315 microversion: 2.1 time: 0.956362 Sep 16 01:54:12.485839 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 20/35] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:11 2022] GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16 => generated 1315 bytes in 968 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:12.500704 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-3092489e-e5b7-407a-9178-898b00d2a1a3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:12.512719 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-3092489e-e5b7-407a-9178-898b00d2a1a3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:12.652513 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-3092489e-e5b7-407a-9178-898b00d2a1a3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:12.661770 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-3092489e-e5b7-407a-9178-898b00d2a1a3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:12.665742 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-3092489e-e5b7-407a-9178-898b00d2a1a3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:12.667117 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-3092489e-e5b7-407a-9178-898b00d2a1a3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1282 microversion: 2.20 time: 0.176760 Sep 16 01:54:12.684887 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 21/36] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:54:12 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1282 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:54:12.692020 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-e51d6cb3-87c0-406c-be79-f99942baa4a3 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:12.693379 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-e51d6cb3-87c0-406c-be79-f99942baa4a3 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:12.851548 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-e51d6cb3-87c0-406c-be79-f99942baa4a3 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:12.859500 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-e51d6cb3-87c0-406c-be79-f99942baa4a3 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1238 microversion: 2.1 time: 0.173388 Sep 16 01:54:12.866680 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 22/37] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:12 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1238 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:13.514162 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-b1b5fde0-7e4b-415c-9e92-e5759d2e3fca tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:13.515651 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-b1b5fde0-7e4b-415c-9e92-e5759d2e3fca tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] [instance: 33b0ab06-b40e-4c13-a33f-cd6a2881fd16] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:13.527115 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b1b5fde0-7e4b-415c-9e92-e5759d2e3fca tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:13.527979 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b1b5fde0-7e4b-415c-9e92-e5759d2e3fca tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:13.528991 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b1b5fde0-7e4b-415c-9e92-e5759d2e3fca tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:13.530167 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b1b5fde0-7e4b-415c-9e92-e5759d2e3fca tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:13.530734 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b1b5fde0-7e4b-415c-9e92-e5759d2e3fca tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:13.531792 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b1b5fde0-7e4b-415c-9e92-e5759d2e3fca tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:13.673949 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.virt.hardware [None req-546d24c3-952d-4720-b557-96a41c7cfbd0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Flavor limits 0:0:0 {{(pid=120440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 01:54:13.674504 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.virt.hardware [None req-546d24c3-952d-4720-b557-96a41c7cfbd0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Image limits 0:0:0 {{(pid=120440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 01:54:13.674902 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.virt.hardware [None req-546d24c3-952d-4720-b557-96a41c7cfbd0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Flavor pref 0:0:0 {{(pid=120440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 01:54:13.675241 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.virt.hardware [None req-546d24c3-952d-4720-b557-96a41c7cfbd0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Image pref 0:0:0 {{(pid=120440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 01:54:13.675677 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.virt.hardware [None req-546d24c3-952d-4720-b557-96a41c7cfbd0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 01:54:13.689022 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-546d24c3-952d-4720-b557-96a41c7cfbd0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:13.689989 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-546d24c3-952d-4720-b557-96a41c7cfbd0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:13.690622 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-546d24c3-952d-4720-b557-96a41c7cfbd0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:13.691510 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-546d24c3-952d-4720-b557-96a41c7cfbd0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:13.692270 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-546d24c3-952d-4720-b557-96a41c7cfbd0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:13.692853 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-546d24c3-952d-4720-b557-96a41c7cfbd0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:13.718238 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.quota [None req-546d24c3-952d-4720-b557-96a41c7cfbd0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Getting quotas for project 57aaf234892543698d91303961f14abd. Resources: {'cores', 'ram', 'instances'} {{(pid=120440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 01:54:13.722764 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.quota [None req-546d24c3-952d-4720-b557-96a41c7cfbd0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Getting quotas for user 7eb6ab0644bf4fa59d7bba232d6ccb3c and project 57aaf234892543698d91303961f14abd. Resources: {'cores', 'ram', 'instances'} {{(pid=120440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 01:54:13.737332 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-546d24c3-952d-4720-b557-96a41c7cfbd0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Going to run 1 instances... {{(pid=120440) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 01:54:13.741264 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-546d24c3-952d-4720-b557-96a41c7cfbd0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 48c9b577-5e65-464f-9328-da6dc694277c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1546da04-912c-44c6-b4b9-34fba35e08f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 01:54:13.816707 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-546d24c3-952d-4720-b557-96a41c7cfbd0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 3.598885 Sep 16 01:54:13.817683 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 16/38] 10.222.0.42 () {60 vars in 1147 bytes} [Fri Sep 16 01:54:10 2022] POST /compute/v2.1/servers => generated 383 bytes in 3600 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 01:54:13.823441 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-74209b4a-018d-4dff-8d9f-7f8521fcade1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:13.824368 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-74209b4a-018d-4dff-8d9f-7f8521fcade1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:13.842504 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-74209b4a-018d-4dff-8d9f-7f8521fcade1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:13.843011 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-74209b4a-018d-4dff-8d9f-7f8521fcade1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:13.843449 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-74209b4a-018d-4dff-8d9f-7f8521fcade1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:13.844820 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-74209b4a-018d-4dff-8d9f-7f8521fcade1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:13.845386 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-74209b4a-018d-4dff-8d9f-7f8521fcade1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:13.845681 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-74209b4a-018d-4dff-8d9f-7f8521fcade1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:13.862690 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-b1b5fde0-7e4b-415c-9e92-e5759d2e3fca tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a39440ed016445a7bfc7ac7fba6661f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477dd0575c8741b0815ddf5f22297db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:13.871610 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-b1b5fde0-7e4b-415c-9e92-e5759d2e3fca tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] 10.222.0.42 "GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16" status: 200 len: 1315 microversion: 2.1 time: 0.364828 Sep 16 01:54:13.873000 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 23/39] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:13 2022] GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16 => generated 1315 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:13.878133 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-3e1da0cb-3bcf-4d8f-8e04-952bec3dab68 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:13.878976 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-3e1da0cb-3bcf-4d8f-8e04-952bec3dab68 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 48c9b577-5e65-464f-9328-da6dc694277c] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:13.954217 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-3e1da0cb-3bcf-4d8f-8e04-952bec3dab68 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:13.969257 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-3e1da0cb-3bcf-4d8f-8e04-952bec3dab68 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c" status: 200 len: 1222 microversion: 2.1 time: 0.094754 Sep 16 01:54:13.969890 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 24/40] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:13 2022] GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c => generated 1222 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:13.995731 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-54ca1ca9-6337-4891-9da9-44c10f2fa420 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:14.003799 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-54ca1ca9-6337-4891-9da9-44c10f2fa420 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:14.014256 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-54ca1ca9-6337-4891-9da9-44c10f2fa420 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:14.014957 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-54ca1ca9-6337-4891-9da9-44c10f2fa420 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:14.015608 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-54ca1ca9-6337-4891-9da9-44c10f2fa420 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:14.016902 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-54ca1ca9-6337-4891-9da9-44c10f2fa420 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:14.017669 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-54ca1ca9-6337-4891-9da9-44c10f2fa420 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:14.018249 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-54ca1ca9-6337-4891-9da9-44c10f2fa420 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:14.121066 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-54ca1ca9-6337-4891-9da9-44c10f2fa420 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:14.135113 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-54ca1ca9-6337-4891-9da9-44c10f2fa420 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1242 microversion: 2.1 time: 0.150743 Sep 16 01:54:14.136071 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 25/41] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:13 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1242 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:14.208784 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-74209b4a-018d-4dff-8d9f-7f8521fcade1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:14.270364 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-670f9da7-794f-492e-86b5-85074006353a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-595538856", "imageRef": "1546da04-912c-44c6-b4b9-34fba35e08f6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:54:14.308579 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-74209b4a-018d-4dff-8d9f-7f8521fcade1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:14.311770 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-74209b4a-018d-4dff-8d9f-7f8521fcade1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:14.313340 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-74209b4a-018d-4dff-8d9f-7f8521fcade1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1286 microversion: 2.20 time: 0.494304 Sep 16 01:54:14.314683 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 17/42] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:54:13 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1286 bytes in 496 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:54:14.440695 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.network.neutron [None req-670f9da7-794f-492e-86b5-85074006353a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] validate_networks() for [('992cb23b-f0e5-4bb7-a3b2-f0f9634fe190', None, None, None, None, None)] {{(pid=120441) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 01:54:14.526588 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [req-11163569-abae-40ee-aa9a-ea2b32ffe0c8 req-61b24b07-274a-4dda-ab13-b53f31811128 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "33b0ab06-b40e-4c13-a33f-cd6a2881fd16", "tag": "fa997e48-0418-472d-a98e-8a93319ff371"}]} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:54:14.547177 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-11163569-abae-40ee-aa9a-ea2b32ffe0c8 req-61b24b07-274a-4dda-ab13-b53f31811128 service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:14.548137 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-11163569-abae-40ee-aa9a-ea2b32ffe0c8 req-61b24b07-274a-4dda-ab13-b53f31811128 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:14.550776 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-11163569-abae-40ee-aa9a-ea2b32ffe0c8 req-61b24b07-274a-4dda-ab13-b53f31811128 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:14.577539 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.compute.server_external_events [req-11163569-abae-40ee-aa9a-ea2b32ffe0c8 req-61b24b07-274a-4dda-ab13-b53f31811128 service nova] Creating event network-changed:fa997e48-0418-472d-a98e-8a93319ff371 for instance 33b0ab06-b40e-4c13-a33f-cd6a2881fd16 on hv-cinder-84914 Sep 16 01:54:14.578063 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-11163569-abae-40ee-aa9a-ea2b32ffe0c8 req-61b24b07-274a-4dda-ab13-b53f31811128 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120440) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 16 01:54:14.580128 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-11163569-abae-40ee-aa9a-ea2b32ffe0c8 req-61b24b07-274a-4dda-ab13-b53f31811128 service nova] Acquired lock "compute-rpcapi-router" {{(pid=120440) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 16 01:54:14.581536 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1e028e8b-fbbf-4790-be6b-81d84594e8bb None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:14.582537 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1e028e8b-fbbf-4790-be6b-81d84594e8bb None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:14.583218 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1e028e8b-fbbf-4790-be6b-81d84594e8bb None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:14.585360 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1e028e8b-fbbf-4790-be6b-81d84594e8bb None None] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:14.586323 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1e028e8b-fbbf-4790-be6b-81d84594e8bb None None] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:14.586992 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1e028e8b-fbbf-4790-be6b-81d84594e8bb None None] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:14.601673 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.compute.rpcapi [None req-1e028e8b-fbbf-4790-be6b-81d84594e8bb None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 16 01:54:14.602912 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1e028e8b-fbbf-4790-be6b-81d84594e8bb None None] Releasing lock "compute-rpcapi-router" {{(pid=120440) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 16 01:54:14.631278 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-1e028e8b-fbbf-4790-be6b-81d84594e8bb None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.229503 Sep 16 01:54:14.633098 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 18/43] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 01:54:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 01:54:14.898075 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-a33b69c3-7f9f-4fa9-ba79-e346e6579028 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:14.899680 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-a33b69c3-7f9f-4fa9-ba79-e346e6579028 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] [instance: 33b0ab06-b40e-4c13-a33f-cd6a2881fd16] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:14.906473 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a33b69c3-7f9f-4fa9-ba79-e346e6579028 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:14.907239 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a33b69c3-7f9f-4fa9-ba79-e346e6579028 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:14.907736 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a33b69c3-7f9f-4fa9-ba79-e346e6579028 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:14.908512 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a33b69c3-7f9f-4fa9-ba79-e346e6579028 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:14.909026 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a33b69c3-7f9f-4fa9-ba79-e346e6579028 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:14.909511 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a33b69c3-7f9f-4fa9-ba79-e346e6579028 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:14.920619 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.virt.hardware [None req-670f9da7-794f-492e-86b5-85074006353a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Flavor limits 0:0:0 {{(pid=120441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 01:54:14.921142 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.virt.hardware [None req-670f9da7-794f-492e-86b5-85074006353a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Image limits 0:0:0 {{(pid=120441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 01:54:14.921504 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.virt.hardware [None req-670f9da7-794f-492e-86b5-85074006353a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Flavor pref 0:0:0 {{(pid=120441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 01:54:14.922151 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.virt.hardware [None req-670f9da7-794f-492e-86b5-85074006353a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Image pref 0:0:0 {{(pid=120441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 01:54:14.922589 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.virt.hardware [None req-670f9da7-794f-492e-86b5-85074006353a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 01:54:14.934070 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-670f9da7-794f-492e-86b5-85074006353a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:14.934800 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-670f9da7-794f-492e-86b5-85074006353a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:14.935240 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-670f9da7-794f-492e-86b5-85074006353a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:14.936159 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-670f9da7-794f-492e-86b5-85074006353a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:14.936620 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-670f9da7-794f-492e-86b5-85074006353a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:14.937223 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-670f9da7-794f-492e-86b5-85074006353a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:14.954637 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.quota [None req-670f9da7-794f-492e-86b5-85074006353a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Getting quotas for project 57aaf234892543698d91303961f14abd. Resources: {'cores', 'ram', 'instances'} {{(pid=120441) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 01:54:14.958647 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.quota [None req-670f9da7-794f-492e-86b5-85074006353a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Getting quotas for user 7eb6ab0644bf4fa59d7bba232d6ccb3c and project 57aaf234892543698d91303961f14abd. Resources: {'cores', 'ram', 'instances'} {{(pid=120441) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 01:54:14.976867 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-670f9da7-794f-492e-86b5-85074006353a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Going to run 1 instances... {{(pid=120441) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 01:54:14.979290 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-670f9da7-794f-492e-86b5-85074006353a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1546da04-912c-44c6-b4b9-34fba35e08f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120441) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 01:54:15.027875 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-670f9da7-794f-492e-86b5-85074006353a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 0.767279 Sep 16 01:54:15.028848 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 26/44] 10.222.0.42 () {60 vars in 1147 bytes} [Fri Sep 16 01:54:14 2022] POST /compute/v2.1/servers => generated 383 bytes in 769 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 01:54:15.048236 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-708b0799-2f9e-467b-be03-ea2740681768 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:15.050666 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-708b0799-2f9e-467b-be03-ea2740681768 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:15.102297 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-a33b69c3-7f9f-4fa9-ba79-e346e6579028 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a39440ed016445a7bfc7ac7fba6661f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477dd0575c8741b0815ddf5f22297db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:15.113512 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-a33b69c3-7f9f-4fa9-ba79-e346e6579028 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] 10.222.0.42 "GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16" status: 200 len: 1315 microversion: 2.1 time: 0.220110 Sep 16 01:54:15.114551 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 19/45] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:14 2022] GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 01:54:15.136581 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-708b0799-2f9e-467b-be03-ea2740681768 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:15.143532 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-708b0799-2f9e-467b-be03-ea2740681768 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1221 microversion: 2.1 time: 0.102814 Sep 16 01:54:15.144124 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 27/46] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:15 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1221 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:15.160735 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-2aa25690-4420-47fa-8144-8276d6756a5a tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:15.161418 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-2aa25690-4420-47fa-8144-8276d6756a5a tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:15.169738 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2aa25690-4420-47fa-8144-8276d6756a5a tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:15.170298 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2aa25690-4420-47fa-8144-8276d6756a5a tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:15.170732 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2aa25690-4420-47fa-8144-8276d6756a5a tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:15.171426 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2aa25690-4420-47fa-8144-8276d6756a5a tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:15.171877 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2aa25690-4420-47fa-8144-8276d6756a5a tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:15.172338 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2aa25690-4420-47fa-8144-8276d6756a5a tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:15.248587 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-2aa25690-4420-47fa-8144-8276d6756a5a tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:15.257249 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-2aa25690-4420-47fa-8144-8276d6756a5a tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1242 microversion: 2.1 time: 0.100424 Sep 16 01:54:15.257828 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 20/47] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:15 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1242 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:15.344522 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-dbb4e7f5-15fd-4085-b243-c31894ee0e60 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:15.345197 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-dbb4e7f5-15fd-4085-b243-c31894ee0e60 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:15.351439 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-dbb4e7f5-15fd-4085-b243-c31894ee0e60 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:15.352200 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-dbb4e7f5-15fd-4085-b243-c31894ee0e60 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:15.352650 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-dbb4e7f5-15fd-4085-b243-c31894ee0e60 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:15.353372 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-dbb4e7f5-15fd-4085-b243-c31894ee0e60 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:15.353975 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-dbb4e7f5-15fd-4085-b243-c31894ee0e60 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:15.354551 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-dbb4e7f5-15fd-4085-b243-c31894ee0e60 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:15.439129 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-dbb4e7f5-15fd-4085-b243-c31894ee0e60 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:15.448179 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-dbb4e7f5-15fd-4085-b243-c31894ee0e60 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:15.450217 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-dbb4e7f5-15fd-4085-b243-c31894ee0e60 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:15.451346 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-dbb4e7f5-15fd-4085-b243-c31894ee0e60 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1286 microversion: 2.20 time: 0.110790 Sep 16 01:54:15.451892 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 28/48] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:54:15 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1286 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:54:16.137871 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-6320254f-bd02-48df-bca1-c3ea1fbc9b1a tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:16.139328 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-6320254f-bd02-48df-bca1-c3ea1fbc9b1a tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] [instance: 33b0ab06-b40e-4c13-a33f-cd6a2881fd16] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:16.145564 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6320254f-bd02-48df-bca1-c3ea1fbc9b1a tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:16.146132 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6320254f-bd02-48df-bca1-c3ea1fbc9b1a tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:16.146647 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6320254f-bd02-48df-bca1-c3ea1fbc9b1a tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:16.147718 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6320254f-bd02-48df-bca1-c3ea1fbc9b1a tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:16.148306 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6320254f-bd02-48df-bca1-c3ea1fbc9b1a tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:16.148930 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6320254f-bd02-48df-bca1-c3ea1fbc9b1a tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:16.170489 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-60d22bce-0610-4fa7-81ca-81c1ad32eb1a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:16.171176 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-60d22bce-0610-4fa7-81ca-81c1ad32eb1a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:16.184814 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-60d22bce-0610-4fa7-81ca-81c1ad32eb1a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:16.185679 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-60d22bce-0610-4fa7-81ca-81c1ad32eb1a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:16.186284 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-60d22bce-0610-4fa7-81ca-81c1ad32eb1a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:16.187793 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-60d22bce-0610-4fa7-81ca-81c1ad32eb1a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:16.188670 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-60d22bce-0610-4fa7-81ca-81c1ad32eb1a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:16.189111 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-60d22bce-0610-4fa7-81ca-81c1ad32eb1a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:16.274729 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-60d22bce-0610-4fa7-81ca-81c1ad32eb1a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:16.284261 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-60d22bce-0610-4fa7-81ca-81c1ad32eb1a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1225 microversion: 2.1 time: 0.117710 Sep 16 01:54:16.301687 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 29/49] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:16 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1225 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:16.308953 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-957a32c0-376b-469d-a8ae-8329a962da47 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:16.309599 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-957a32c0-376b-469d-a8ae-8329a962da47 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:16.315665 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-957a32c0-376b-469d-a8ae-8329a962da47 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:16.316364 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-957a32c0-376b-469d-a8ae-8329a962da47 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:16.316936 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-957a32c0-376b-469d-a8ae-8329a962da47 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:16.317756 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-957a32c0-376b-469d-a8ae-8329a962da47 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:16.318347 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-957a32c0-376b-469d-a8ae-8329a962da47 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:16.318975 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-957a32c0-376b-469d-a8ae-8329a962da47 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:16.340991 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-6320254f-bd02-48df-bca1-c3ea1fbc9b1a tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a39440ed016445a7bfc7ac7fba6661f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477dd0575c8741b0815ddf5f22297db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:16.355339 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-6320254f-bd02-48df-bca1-c3ea1fbc9b1a tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] 10.222.0.42 "GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16" status: 200 len: 1315 microversion: 2.1 time: 0.221641 Sep 16 01:54:16.356407 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 21/50] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:16 2022] GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16 => generated 1315 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 01:54:16.432733 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-957a32c0-376b-469d-a8ae-8329a962da47 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:16.442476 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-957a32c0-376b-469d-a8ae-8329a962da47 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1242 microversion: 2.1 time: 0.139516 Sep 16 01:54:16.445202 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 30/51] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:16 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1242 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:16.483537 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-ccb51b4e-4333-4163-9b71-903304f912b3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:16.484335 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-ccb51b4e-4333-4163-9b71-903304f912b3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:16.491993 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ccb51b4e-4333-4163-9b71-903304f912b3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:16.492860 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ccb51b4e-4333-4163-9b71-903304f912b3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:16.493542 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ccb51b4e-4333-4163-9b71-903304f912b3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:16.501177 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ccb51b4e-4333-4163-9b71-903304f912b3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:16.502269 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ccb51b4e-4333-4163-9b71-903304f912b3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:16.503000 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ccb51b4e-4333-4163-9b71-903304f912b3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:16.603366 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-ccb51b4e-4333-4163-9b71-903304f912b3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:16.613363 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-ccb51b4e-4333-4163-9b71-903304f912b3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:16.614852 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-ccb51b4e-4333-4163-9b71-903304f912b3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:16.616919 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-ccb51b4e-4333-4163-9b71-903304f912b3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1286 microversion: 2.20 time: 0.137304 Sep 16 01:54:16.618334 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 22/52] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:54:16 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1286 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:54:17.313528 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-b34959e5-e71e-4b35-a8f2-d2e02923fe4d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:17.314745 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-b34959e5-e71e-4b35-a8f2-d2e02923fe4d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:17.318176 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_api:SELECT=92,nova_api:INSERT=8 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:17.323373 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b34959e5-e71e-4b35-a8f2-d2e02923fe4d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:17.323968 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b34959e5-e71e-4b35-a8f2-d2e02923fe4d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:17.324411 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b34959e5-e71e-4b35-a8f2-d2e02923fe4d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:17.325284 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b34959e5-e71e-4b35-a8f2-d2e02923fe4d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:17.325748 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b34959e5-e71e-4b35-a8f2-d2e02923fe4d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:17.326206 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b34959e5-e71e-4b35-a8f2-d2e02923fe4d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:17.386125 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-6fb7d544-fba8-4775-b3b5-074e723f1956 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:17.386964 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-6fb7d544-fba8-4775-b3b5-074e723f1956 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] [instance: 33b0ab06-b40e-4c13-a33f-cd6a2881fd16] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:17.393136 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6fb7d544-fba8-4775-b3b5-074e723f1956 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:17.393929 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6fb7d544-fba8-4775-b3b5-074e723f1956 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:17.394757 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6fb7d544-fba8-4775-b3b5-074e723f1956 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:17.395905 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6fb7d544-fba8-4775-b3b5-074e723f1956 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:17.396589 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6fb7d544-fba8-4775-b3b5-074e723f1956 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:17.397402 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6fb7d544-fba8-4775-b3b5-074e723f1956 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:17.405147 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-b34959e5-e71e-4b35-a8f2-d2e02923fe4d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:17.415574 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-b34959e5-e71e-4b35-a8f2-d2e02923fe4d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1225 microversion: 2.1 time: 0.105635 Sep 16 01:54:17.417605 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 31/53] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:17 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1225 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:17.468494 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-8e014772-cebb-410a-a8b9-076209865616 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:17.469497 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-8e014772-cebb-410a-a8b9-076209865616 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:17.479780 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8e014772-cebb-410a-a8b9-076209865616 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:17.480301 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8e014772-cebb-410a-a8b9-076209865616 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:17.480742 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8e014772-cebb-410a-a8b9-076209865616 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:17.481442 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8e014772-cebb-410a-a8b9-076209865616 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:17.482197 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8e014772-cebb-410a-a8b9-076209865616 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:17.482626 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8e014772-cebb-410a-a8b9-076209865616 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:17.585769 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-8e014772-cebb-410a-a8b9-076209865616 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:17.612914 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-8e014772-cebb-410a-a8b9-076209865616 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1242 microversion: 2.1 time: 0.149709 Sep 16 01:54:17.617362 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 32/54] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:17 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1242 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 01:54:17.645928 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-6fb7d544-fba8-4775-b3b5-074e723f1956 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a39440ed016445a7bfc7ac7fba6661f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477dd0575c8741b0815ddf5f22297db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:17.653338 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-5f9506b5-9a50-455d-b773-ed6605288c1d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:17.655188 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-5f9506b5-9a50-455d-b773-ed6605288c1d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:17.662069 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5f9506b5-9a50-455d-b773-ed6605288c1d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:17.662876 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5f9506b5-9a50-455d-b773-ed6605288c1d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:17.664338 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5f9506b5-9a50-455d-b773-ed6605288c1d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:17.665202 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5f9506b5-9a50-455d-b773-ed6605288c1d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:17.665802 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5f9506b5-9a50-455d-b773-ed6605288c1d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:17.666581 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5f9506b5-9a50-455d-b773-ed6605288c1d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:17.670597 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-6fb7d544-fba8-4775-b3b5-074e723f1956 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] 10.222.0.42 "GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16" status: 200 len: 1315 microversion: 2.1 time: 0.292032 Sep 16 01:54:17.679726 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 23/55] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:17 2022] GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16 => generated 1315 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:17.849139 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-5f9506b5-9a50-455d-b773-ed6605288c1d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:17.876950 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-5f9506b5-9a50-455d-b773-ed6605288c1d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:17.882578 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-5f9506b5-9a50-455d-b773-ed6605288c1d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:17.885483 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-5f9506b5-9a50-455d-b773-ed6605288c1d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1286 microversion: 2.20 time: 0.243822 Sep 16 01:54:17.887556 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 33/56] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:54:17 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1286 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:54:18.444375 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-6bbb71f5-d496-4aaa-8c49-a0bd55847053 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:18.445263 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-6bbb71f5-d496-4aaa-8c49-a0bd55847053 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:18.458783 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6bbb71f5-d496-4aaa-8c49-a0bd55847053 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:18.459304 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6bbb71f5-d496-4aaa-8c49-a0bd55847053 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:18.460989 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6bbb71f5-d496-4aaa-8c49-a0bd55847053 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:18.462224 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6bbb71f5-d496-4aaa-8c49-a0bd55847053 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:18.462860 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6bbb71f5-d496-4aaa-8c49-a0bd55847053 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:18.463448 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6bbb71f5-d496-4aaa-8c49-a0bd55847053 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:18.583214 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-6bbb71f5-d496-4aaa-8c49-a0bd55847053 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:18.596520 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-6bbb71f5-d496-4aaa-8c49-a0bd55847053 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1225 microversion: 2.1 time: 0.160930 Sep 16 01:54:18.597426 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 24/57] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:18 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1225 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:18.640183 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-8d63e606-48e7-40a2-8115-d6e3fa3e4203 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:18.640858 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-8d63e606-48e7-40a2-8115-d6e3fa3e4203 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:18.662188 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8d63e606-48e7-40a2-8115-d6e3fa3e4203 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:18.664289 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8d63e606-48e7-40a2-8115-d6e3fa3e4203 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:18.665182 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8d63e606-48e7-40a2-8115-d6e3fa3e4203 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:18.666123 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8d63e606-48e7-40a2-8115-d6e3fa3e4203 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:18.667964 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8d63e606-48e7-40a2-8115-d6e3fa3e4203 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:18.668600 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8d63e606-48e7-40a2-8115-d6e3fa3e4203 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:18.701782 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-70fcaee6-0a44-4624-89ac-90e1ec8b6812 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:18.702729 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-70fcaee6-0a44-4624-89ac-90e1ec8b6812 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] [instance: 33b0ab06-b40e-4c13-a33f-cd6a2881fd16] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:18.718025 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-70fcaee6-0a44-4624-89ac-90e1ec8b6812 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:18.719596 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-70fcaee6-0a44-4624-89ac-90e1ec8b6812 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:18.721606 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-70fcaee6-0a44-4624-89ac-90e1ec8b6812 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:18.727382 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-70fcaee6-0a44-4624-89ac-90e1ec8b6812 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:18.729135 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-70fcaee6-0a44-4624-89ac-90e1ec8b6812 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:18.733768 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-70fcaee6-0a44-4624-89ac-90e1ec8b6812 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:18.750383 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-8d63e606-48e7-40a2-8115-d6e3fa3e4203 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:18.762135 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-8d63e606-48e7-40a2-8115-d6e3fa3e4203 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1242 microversion: 2.1 time: 0.126952 Sep 16 01:54:18.763481 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 34/58] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:18 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1242 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:18.884266 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-fab71d9f-4fc3-4cb3-9bbb-f803c18ef1f4 tempest-VolumesTestJSON-1828391923 tempest-VolumesTestJSON-1828391923-project] Calling method '.version_select at 0x7fae33678b80>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:19.025420 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-fab71d9f-4fc3-4cb3-9bbb-f803c18ef1f4 tempest-VolumesTestJSON-1828391923 tempest-VolumesTestJSON-1828391923-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/b2cbaea0-bd06-4092-b156-b38c2fa561b8" status: 200 len: 350 microversion: 2.1 time: 0.146851 Sep 16 01:54:19.026111 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 35/59] 10.222.0.42 () {58 vars in 1245 bytes} [Fri Sep 16 01:54:18 2022] GET /compute/v2.1/os-volumes/b2cbaea0-bd06-4092-b156-b38c2fa561b8 => generated 350 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 01:54:19.031578 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-3a2a1850-620f-42d8-b4e7-9e59e79829f4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:19.032798 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-3a2a1850-620f-42d8-b4e7-9e59e79829f4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:19.055454 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3a2a1850-620f-42d8-b4e7-9e59e79829f4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:19.066596 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3a2a1850-620f-42d8-b4e7-9e59e79829f4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:19.066596 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3a2a1850-620f-42d8-b4e7-9e59e79829f4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:19.068244 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3a2a1850-620f-42d8-b4e7-9e59e79829f4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:19.069350 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3a2a1850-620f-42d8-b4e7-9e59e79829f4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:19.076108 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3a2a1850-620f-42d8-b4e7-9e59e79829f4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:19.106614 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-70fcaee6-0a44-4624-89ac-90e1ec8b6812 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a39440ed016445a7bfc7ac7fba6661f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477dd0575c8741b0815ddf5f22297db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:19.134913 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-70fcaee6-0a44-4624-89ac-90e1ec8b6812 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] 10.222.0.42 "GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16" status: 200 len: 1315 microversion: 2.1 time: 0.421256 Sep 16 01:54:19.135788 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 25/60] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:18 2022] GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16 => generated 1315 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:19.192577 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-3a2a1850-620f-42d8-b4e7-9e59e79829f4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:19.203134 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-3a2a1850-620f-42d8-b4e7-9e59e79829f4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:19.204640 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-3a2a1850-620f-42d8-b4e7-9e59e79829f4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:19.205722 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-3a2a1850-620f-42d8-b4e7-9e59e79829f4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1334 microversion: 2.20 time: 0.178427 Sep 16 01:54:19.212432 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 36/61] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:54:19 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1334 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:54:19.627773 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-41b1b837-f016-47c0-b6d7-301e8eaac960 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:19.632310 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-41b1b837-f016-47c0-b6d7-301e8eaac960 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:19.641926 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-41b1b837-f016-47c0-b6d7-301e8eaac960 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:19.642712 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-41b1b837-f016-47c0-b6d7-301e8eaac960 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:19.643354 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-41b1b837-f016-47c0-b6d7-301e8eaac960 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:19.644346 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-41b1b837-f016-47c0-b6d7-301e8eaac960 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:19.645000 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-41b1b837-f016-47c0-b6d7-301e8eaac960 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:19.645817 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-41b1b837-f016-47c0-b6d7-301e8eaac960 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:19.790699 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-db532bd1-02a0-4227-a508-7f68e1735dcb tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:19.792017 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-db532bd1-02a0-4227-a508-7f68e1735dcb tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:19.799081 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-db532bd1-02a0-4227-a508-7f68e1735dcb tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:19.801326 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-db532bd1-02a0-4227-a508-7f68e1735dcb tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:19.817607 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-db532bd1-02a0-4227-a508-7f68e1735dcb tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:19.822029 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-db532bd1-02a0-4227-a508-7f68e1735dcb tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:19.824573 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-db532bd1-02a0-4227-a508-7f68e1735dcb tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:19.826482 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-db532bd1-02a0-4227-a508-7f68e1735dcb tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:19.842081 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-41b1b837-f016-47c0-b6d7-301e8eaac960 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:19.855754 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-41b1b837-f016-47c0-b6d7-301e8eaac960 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1225 microversion: 2.1 time: 0.237717 Sep 16 01:54:19.857154 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 26/62] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:19 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1225 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:19.958891 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-db532bd1-02a0-4227-a508-7f68e1735dcb tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:19.969822 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-db532bd1-02a0-4227-a508-7f68e1735dcb tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1234 microversion: 2.1 time: 0.184787 Sep 16 01:54:19.993736 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 37/63] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:19 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1234 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:20.161931 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-667841b0-38f7-4b89-a935-1b1e7a6fbd24 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:20.163562 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-667841b0-38f7-4b89-a935-1b1e7a6fbd24 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] [instance: 33b0ab06-b40e-4c13-a33f-cd6a2881fd16] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:20.170996 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-667841b0-38f7-4b89-a935-1b1e7a6fbd24 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:20.171841 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-667841b0-38f7-4b89-a935-1b1e7a6fbd24 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:20.172847 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-667841b0-38f7-4b89-a935-1b1e7a6fbd24 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:20.173807 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-667841b0-38f7-4b89-a935-1b1e7a6fbd24 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:20.174693 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-667841b0-38f7-4b89-a935-1b1e7a6fbd24 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:20.176493 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-667841b0-38f7-4b89-a935-1b1e7a6fbd24 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:20.234353 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-27113785-8a00-48fa-b4c8-9ffd10bd11be tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:20.234978 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-27113785-8a00-48fa-b4c8-9ffd10bd11be tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:20.241772 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-27113785-8a00-48fa-b4c8-9ffd10bd11be tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:20.242270 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-27113785-8a00-48fa-b4c8-9ffd10bd11be tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:20.244162 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-27113785-8a00-48fa-b4c8-9ffd10bd11be tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:20.245112 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-27113785-8a00-48fa-b4c8-9ffd10bd11be tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:20.246700 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-27113785-8a00-48fa-b4c8-9ffd10bd11be tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:20.247482 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-27113785-8a00-48fa-b4c8-9ffd10bd11be tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:20.366675 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-667841b0-38f7-4b89-a935-1b1e7a6fbd24 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a39440ed016445a7bfc7ac7fba6661f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477dd0575c8741b0815ddf5f22297db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:20.370915 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-27113785-8a00-48fa-b4c8-9ffd10bd11be tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:20.374872 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-667841b0-38f7-4b89-a935-1b1e7a6fbd24 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] 10.222.0.42 "GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16" status: 200 len: 1315 microversion: 2.1 time: 0.217743 Sep 16 01:54:20.376408 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 27/64] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:20 2022] GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16 => generated 1315 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:20.380589 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-27113785-8a00-48fa-b4c8-9ffd10bd11be tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:20.383389 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-27113785-8a00-48fa-b4c8-9ffd10bd11be tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:20.384782 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-27113785-8a00-48fa-b4c8-9ffd10bd11be tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1334 microversion: 2.20 time: 0.154639 Sep 16 01:54:20.390933 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 38/65] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:54:20 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1334 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:54:20.664503 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-90233fff-f194-4d09-b6ca-6c1392170257 tempest-VolumesTestJSON-1828391923 tempest-VolumesTestJSON-1828391923-project] Calling method '.version_select at 0x7fae32e5e280>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:20.801012 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-90233fff-f194-4d09-b6ca-6c1392170257 tempest-VolumesTestJSON-1828391923 tempest-VolumesTestJSON-1828391923-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/26b78570-795d-490b-b8b5-5d5aed92b4b4" status: 200 len: 350 microversion: 2.1 time: 0.140465 Sep 16 01:54:20.801459 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 28/66] 10.222.0.42 () {58 vars in 1245 bytes} [Fri Sep 16 01:54:20 2022] GET /compute/v2.1/os-volumes/26b78570-795d-490b-b8b5-5d5aed92b4b4 => generated 350 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:54:20.883508 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-e0e95854-6998-44ed-a1ca-ee7494991ebd tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:20.884758 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-e0e95854-6998-44ed-a1ca-ee7494991ebd tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:20.896275 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e0e95854-6998-44ed-a1ca-ee7494991ebd tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:20.896855 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e0e95854-6998-44ed-a1ca-ee7494991ebd tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:20.897544 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e0e95854-6998-44ed-a1ca-ee7494991ebd tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:20.900298 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e0e95854-6998-44ed-a1ca-ee7494991ebd tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:20.901105 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e0e95854-6998-44ed-a1ca-ee7494991ebd tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:20.901681 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e0e95854-6998-44ed-a1ca-ee7494991ebd tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:20.986980 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-e0e95854-6998-44ed-a1ca-ee7494991ebd tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:20.995351 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell1:SELECT=100 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:20.998736 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-e0e95854-6998-44ed-a1ca-ee7494991ebd tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1217 microversion: 2.1 time: 0.121564 Sep 16 01:54:21.000607 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-59521210-86a6-469c-80b0-fa4062697367 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:21.001789 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-59521210-86a6-469c-80b0-fa4062697367 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:21.011799 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-59521210-86a6-469c-80b0-fa4062697367 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:21.012528 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-59521210-86a6-469c-80b0-fa4062697367 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:21.013133 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-59521210-86a6-469c-80b0-fa4062697367 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:21.013995 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-59521210-86a6-469c-80b0-fa4062697367 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:21.014957 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-59521210-86a6-469c-80b0-fa4062697367 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:21.016721 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 39/67] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:20 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1217 bytes in 140 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:21.017363 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-59521210-86a6-469c-80b0-fa4062697367 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:21.136732 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-59521210-86a6-469c-80b0-fa4062697367 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:21.146682 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-59521210-86a6-469c-80b0-fa4062697367 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1234 microversion: 2.1 time: 0.152011 Sep 16 01:54:21.148646 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 29/68] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:20 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1234 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:21.413455 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-484e30e7-6689-40ba-8f0c-807a65889ef7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:21.414813 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-484e30e7-6689-40ba-8f0c-807a65889ef7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] [instance: 33b0ab06-b40e-4c13-a33f-cd6a2881fd16] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:21.418864 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-cb7fd9cf-21aa-429e-b21b-77a64d1dee25 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:21.420126 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-cb7fd9cf-21aa-429e-b21b-77a64d1dee25 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:21.431289 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-484e30e7-6689-40ba-8f0c-807a65889ef7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:21.431624 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cb7fd9cf-21aa-429e-b21b-77a64d1dee25 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:21.431867 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cb7fd9cf-21aa-429e-b21b-77a64d1dee25 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:21.432487 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cb7fd9cf-21aa-429e-b21b-77a64d1dee25 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:21.435311 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-484e30e7-6689-40ba-8f0c-807a65889ef7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:21.435997 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cb7fd9cf-21aa-429e-b21b-77a64d1dee25 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:21.436131 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-484e30e7-6689-40ba-8f0c-807a65889ef7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:21.437060 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cb7fd9cf-21aa-429e-b21b-77a64d1dee25 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:21.438212 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-484e30e7-6689-40ba-8f0c-807a65889ef7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:21.438891 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-484e30e7-6689-40ba-8f0c-807a65889ef7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:21.439541 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-484e30e7-6689-40ba-8f0c-807a65889ef7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:21.442025 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cb7fd9cf-21aa-429e-b21b-77a64d1dee25 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:21.597912 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-cb7fd9cf-21aa-429e-b21b-77a64d1dee25 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:21.621109 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-cb7fd9cf-21aa-429e-b21b-77a64d1dee25 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:21.622663 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-cb7fd9cf-21aa-429e-b21b-77a64d1dee25 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:21.629342 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-cb7fd9cf-21aa-429e-b21b-77a64d1dee25 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1334 microversion: 2.20 time: 0.209465 Sep 16 01:54:21.641919 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 30/69] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:54:21 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1334 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 01:54:21.703749 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-484e30e7-6689-40ba-8f0c-807a65889ef7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a39440ed016445a7bfc7ac7fba6661f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477dd0575c8741b0815ddf5f22297db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:21.712178 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-484e30e7-6689-40ba-8f0c-807a65889ef7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] 10.222.0.42 "GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16" status: 200 len: 1315 microversion: 2.1 time: 0.305102 Sep 16 01:54:21.712808 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 40/70] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:21 2022] GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16 => generated 1315 bytes in 307 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:22.025134 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-7d02eccb-f880-406c-af6c-a0af14a0be2a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:22.025748 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-7d02eccb-f880-406c-af6c-a0af14a0be2a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:22.036691 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7d02eccb-f880-406c-af6c-a0af14a0be2a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:22.039174 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7d02eccb-f880-406c-af6c-a0af14a0be2a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:22.039861 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7d02eccb-f880-406c-af6c-a0af14a0be2a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:22.042601 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7d02eccb-f880-406c-af6c-a0af14a0be2a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:22.044167 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7d02eccb-f880-406c-af6c-a0af14a0be2a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:22.045774 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7d02eccb-f880-406c-af6c-a0af14a0be2a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:22.126658 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-7d02eccb-f880-406c-af6c-a0af14a0be2a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:22.135670 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-7d02eccb-f880-406c-af6c-a0af14a0be2a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1217 microversion: 2.1 time: 0.115413 Sep 16 01:54:22.136457 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 31/71] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:22 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1217 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:22.172659 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-69fc155b-6d4a-446a-b990-73740ab1ce3b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:22.173296 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-69fc155b-6d4a-446a-b990-73740ab1ce3b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:22.180670 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-69fc155b-6d4a-446a-b990-73740ab1ce3b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:22.180766 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-69fc155b-6d4a-446a-b990-73740ab1ce3b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:22.181437 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-69fc155b-6d4a-446a-b990-73740ab1ce3b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:22.182151 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-69fc155b-6d4a-446a-b990-73740ab1ce3b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:22.182598 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-69fc155b-6d4a-446a-b990-73740ab1ce3b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:22.183189 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-69fc155b-6d4a-446a-b990-73740ab1ce3b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:22.250771 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-69fc155b-6d4a-446a-b990-73740ab1ce3b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:22.259905 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-69fc155b-6d4a-446a-b990-73740ab1ce3b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1234 microversion: 2.1 time: 0.091724 Sep 16 01:54:22.260979 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 41/72] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:22 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1234 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:22.384398 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-88ed89c0-9504-476d-a301-1de9aed7ea07 tempest-VolumesTestJSON-1828391923 tempest-VolumesTestJSON-1828391923-project] Calling method '.version_select at 0x7fae32e805e0>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:22.437910 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-88ed89c0-9504-476d-a301-1de9aed7ea07 tempest-VolumesTestJSON-1828391923 tempest-VolumesTestJSON-1828391923-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/278323e9-9419-43be-b0ed-adb4ce425112" status: 200 len: 350 microversion: 2.1 time: 0.058368 Sep 16 01:54:22.438957 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 32/73] 10.222.0.42 () {58 vars in 1245 bytes} [Fri Sep 16 01:54:22 2022] GET /compute/v2.1/os-volumes/278323e9-9419-43be-b0ed-adb4ce425112 => generated 350 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:54:22.453856 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-753b57bd-e508-48fa-b111-4412c15fb38d tempest-VolumesTestJSON-1828391923 tempest-VolumesTestJSON-1828391923-project] Calling method '.version_select at 0x7fae3368caf0>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:22.554304 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-753b57bd-e508-48fa-b111-4412c15fb38d tempest-VolumesTestJSON-1828391923 tempest-VolumesTestJSON-1828391923-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.104476 Sep 16 01:54:22.555480 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 42/74] 10.222.0.42 () {58 vars in 1134 bytes} [Fri Sep 16 01:54:22 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:22.570397 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-ca095bb8-40db-4b6a-9bfe-6d42692aa112 tempest-VolumesTestJSON-1828391923 tempest-VolumesTestJSON-1828391923-project] Calling method '.version_select at 0x7fae32e80550>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:22.649620 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-3624360b-beca-429c-a60c-344aa89b6f32 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:22.651831 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-3624360b-beca-429c-a60c-344aa89b6f32 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:22.661934 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3624360b-beca-429c-a60c-344aa89b6f32 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:22.665029 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3624360b-beca-429c-a60c-344aa89b6f32 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:22.666019 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3624360b-beca-429c-a60c-344aa89b6f32 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:22.666845 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3624360b-beca-429c-a60c-344aa89b6f32 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:22.667860 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3624360b-beca-429c-a60c-344aa89b6f32 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:22.668593 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3624360b-beca-429c-a60c-344aa89b6f32 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:22.707039 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-ca095bb8-40db-4b6a-9bfe-6d42692aa112 tempest-VolumesTestJSON-1828391923 tempest-VolumesTestJSON-1828391923-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.141123 Sep 16 01:54:22.708429 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 33/75] 10.222.0.42 () {58 vars in 1149 bytes} [Fri Sep 16 01:54:22 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 01:54:22.723696 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-8ed2f1ed-28e6-42eb-8463-5cb099724ed8 tempest-VolumesTestJSON-1828391923 tempest-VolumesTestJSON-1828391923-project] Calling method '.version_select at 0x7fae32e6b940>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:22.814701 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-3624360b-beca-429c-a60c-344aa89b6f32 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:22.825052 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-3624360b-beca-429c-a60c-344aa89b6f32 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:22.828208 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-3624360b-beca-429c-a60c-344aa89b6f32 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:22.832034 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-3624360b-beca-429c-a60c-344aa89b6f32 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1334 microversion: 2.20 time: 0.184033 Sep 16 01:54:22.833348 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 43/76] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:54:22 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1334 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 01:54:22.847143 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-70c00e89-35fe-4f0d-a4b0-1c3175a9d22a tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:22.847851 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-70c00e89-35fe-4f0d-a4b0-1c3175a9d22a tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] [instance: 33b0ab06-b40e-4c13-a33f-cd6a2881fd16] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:22.870373 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-70c00e89-35fe-4f0d-a4b0-1c3175a9d22a tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:22.871733 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-70c00e89-35fe-4f0d-a4b0-1c3175a9d22a tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:22.872211 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-70c00e89-35fe-4f0d-a4b0-1c3175a9d22a tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:22.872933 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-70c00e89-35fe-4f0d-a4b0-1c3175a9d22a tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:22.873391 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-70c00e89-35fe-4f0d-a4b0-1c3175a9d22a tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:22.873846 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-70c00e89-35fe-4f0d-a4b0-1c3175a9d22a tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:22.880410 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-8ed2f1ed-28e6-42eb-8463-5cb099724ed8 tempest-VolumesTestJSON-1828391923 tempest-VolumesTestJSON-1828391923-project] 10.222.0.42 "GET /compute/v2.1/os-volumes" status: 200 len: 1033 microversion: 2.1 time: 0.161319 Sep 16 01:54:22.882016 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 34/77] 10.222.0.42 () {58 vars in 1134 bytes} [Fri Sep 16 01:54:22 2022] GET /compute/v2.1/os-volumes => generated 1033 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:22.900198 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-a27cbeb4-e0f2-461b-ab1f-37efb09f777a tempest-VolumesTestJSON-1828391923 tempest-VolumesTestJSON-1828391923-project] Calling method '.version_select at 0x7fae32e5e700>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:23.004263 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-a27cbeb4-e0f2-461b-ab1f-37efb09f777a tempest-VolumesTestJSON-1828391923 tempest-VolumesTestJSON-1828391923-project] 10.222.0.42 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.112507 Sep 16 01:54:23.005208 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 35/78] 10.222.0.42 () {58 vars in 1167 bytes} [Fri Sep 16 01:54:22 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:54:23.025107 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-2c34d134-16e0-42f8-a6e9-14c7c5b85b28 tempest-VolumesTestJSON-1828391923 tempest-VolumesTestJSON-1828391923-project] Calling method '.version_select at 0x7fae32e80670>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:23.065136 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-70c00e89-35fe-4f0d-a4b0-1c3175a9d22a tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a39440ed016445a7bfc7ac7fba6661f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477dd0575c8741b0815ddf5f22297db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:23.075711 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-70c00e89-35fe-4f0d-a4b0-1c3175a9d22a tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] 10.222.0.42 "GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16" status: 200 len: 1315 microversion: 2.1 time: 0.241086 Sep 16 01:54:23.076739 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 44/79] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:22 2022] GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16 => generated 1315 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:23.125830 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-2c34d134-16e0-42f8-a6e9-14c7c5b85b28 tempest-VolumesTestJSON-1828391923 tempest-VolumesTestJSON-1828391923-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.110173 Sep 16 01:54:23.126407 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 36/80] 10.222.0.42 () {58 vars in 1170 bytes} [Fri Sep 16 01:54:23 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:54:23.141375 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-fd5b5d53-354a-433a-a123-e09c7fd3d8f0 tempest-VolumesTestJSON-1828391923 tempest-VolumesTestJSON-1828391923-project] Calling method '.version_select at 0x7fae32e2aca0>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:23.160733 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-cf365d3e-b8ae-4731-9df5-a3758e156c54 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:23.161354 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-cf365d3e-b8ae-4731-9df5-a3758e156c54 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:23.172546 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cf365d3e-b8ae-4731-9df5-a3758e156c54 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:23.173539 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cf365d3e-b8ae-4731-9df5-a3758e156c54 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:23.174059 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cf365d3e-b8ae-4731-9df5-a3758e156c54 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:23.174863 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cf365d3e-b8ae-4731-9df5-a3758e156c54 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:23.175407 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cf365d3e-b8ae-4731-9df5-a3758e156c54 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:23.175906 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cf365d3e-b8ae-4731-9df5-a3758e156c54 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:23.247646 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-fd5b5d53-354a-433a-a123-e09c7fd3d8f0 tempest-VolumesTestJSON-1828391923 tempest-VolumesTestJSON-1828391923-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.110351 Sep 16 01:54:23.259489 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 45/81] 10.222.0.42 () {58 vars in 1155 bytes} [Fri Sep 16 01:54:23 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:23.265059 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-2c82ba1c-c4b8-4a70-a938-8b5917a95446 tempest-VolumesTestJSON-1828391923 tempest-VolumesTestJSON-1828391923-project] Calling method '.version_select at 0x7fae33678b80>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:23.268979 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-cf365d3e-b8ae-4731-9df5-a3758e156c54 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:23.279399 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-cf365d3e-b8ae-4731-9df5-a3758e156c54 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1217 microversion: 2.1 time: 0.122568 Sep 16 01:54:23.292306 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 37/82] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:23 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1217 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 01:54:23.298302 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-79516e1b-ee21-4b28-85f8-c49f65814787 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:23.299144 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-79516e1b-ee21-4b28-85f8-c49f65814787 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:23.308955 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-79516e1b-ee21-4b28-85f8-c49f65814787 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:23.309843 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-79516e1b-ee21-4b28-85f8-c49f65814787 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:23.310497 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-79516e1b-ee21-4b28-85f8-c49f65814787 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:23.311786 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-79516e1b-ee21-4b28-85f8-c49f65814787 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:23.313147 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-79516e1b-ee21-4b28-85f8-c49f65814787 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:23.313965 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-79516e1b-ee21-4b28-85f8-c49f65814787 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:23.384188 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-79516e1b-ee21-4b28-85f8-c49f65814787 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:23.387643 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell1:SELECT=100 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:23.392408 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-79516e1b-ee21-4b28-85f8-c49f65814787 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1234 microversion: 2.1 time: 0.098594 Sep 16 01:54:23.393155 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 38/83] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:23 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1234 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:23.448255 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-2c82ba1c-c4b8-4a70-a938-8b5917a95446 tempest-VolumesTestJSON-1828391923 tempest-VolumesTestJSON-1828391923-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.187354 Sep 16 01:54:23.448840 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 46/84] 10.222.0.42 () {58 vars in 1188 bytes} [Fri Sep 16 01:54:23 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:54:23.464095 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-6969cb09-e0d8-497e-880f-e338c7684fcd tempest-VolumesTestJSON-1828391923 tempest-VolumesTestJSON-1828391923-project] Calling method '.version_select at 0x7fae32e6b040>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:23.556241 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-6969cb09-e0d8-497e-880f-e338c7684fcd tempest-VolumesTestJSON-1828391923 tempest-VolumesTestJSON-1828391923-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1033 microversion: 2.1 time: 0.096704 Sep 16 01:54:23.557742 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 39/85] 10.222.0.42 () {58 vars in 1155 bytes} [Fri Sep 16 01:54:23 2022] GET /compute/v2.1/os-volumes/detail => generated 1033 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:23.868306 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-cf94e44c-fc90-4d54-b143-4197aa18752b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:23.868922 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-cf94e44c-fc90-4d54-b143-4197aa18752b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:23.875884 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-cf94e44c-fc90-4d54-b143-4197aa18752b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:23.876514 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-cf94e44c-fc90-4d54-b143-4197aa18752b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:23.877011 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-cf94e44c-fc90-4d54-b143-4197aa18752b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:23.877760 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-cf94e44c-fc90-4d54-b143-4197aa18752b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:23.878275 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-cf94e44c-fc90-4d54-b143-4197aa18752b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:23.878760 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-cf94e44c-fc90-4d54-b143-4197aa18752b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:23.951758 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-cf94e44c-fc90-4d54-b143-4197aa18752b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:23.960610 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-cf94e44c-fc90-4d54-b143-4197aa18752b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:23.962147 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-cf94e44c-fc90-4d54-b143-4197aa18752b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:23.963815 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-cf94e44c-fc90-4d54-b143-4197aa18752b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1334 microversion: 2.20 time: 0.100145 Sep 16 01:54:23.964538 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 47/86] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:54:23 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1334 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:54:24.095660 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell0:SELECT=18 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:24.101129 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-289cf73f-5297-4f55-9ef3-9d9358b15524 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:24.101978 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-289cf73f-5297-4f55-9ef3-9d9358b15524 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] [instance: 33b0ab06-b40e-4c13-a33f-cd6a2881fd16] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:24.108682 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-289cf73f-5297-4f55-9ef3-9d9358b15524 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:24.109156 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-289cf73f-5297-4f55-9ef3-9d9358b15524 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:24.109598 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-289cf73f-5297-4f55-9ef3-9d9358b15524 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:24.110389 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-289cf73f-5297-4f55-9ef3-9d9358b15524 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:24.110872 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-289cf73f-5297-4f55-9ef3-9d9358b15524 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:24.111316 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-289cf73f-5297-4f55-9ef3-9d9358b15524 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:24.258525 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-289cf73f-5297-4f55-9ef3-9d9358b15524 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a39440ed016445a7bfc7ac7fba6661f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477dd0575c8741b0815ddf5f22297db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:24.266640 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-289cf73f-5297-4f55-9ef3-9d9358b15524 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] 10.222.0.42 "GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16" status: 200 len: 1315 microversion: 2.1 time: 0.171651 Sep 16 01:54:24.267536 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 40/87] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:24 2022] GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16 => generated 1315 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:24.305760 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-9c5db03c-e6e0-4de0-a2e1-44fe8e0293e3 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:24.307128 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-9c5db03c-e6e0-4de0-a2e1-44fe8e0293e3 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:24.313394 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9c5db03c-e6e0-4de0-a2e1-44fe8e0293e3 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:24.313926 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9c5db03c-e6e0-4de0-a2e1-44fe8e0293e3 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:24.314294 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9c5db03c-e6e0-4de0-a2e1-44fe8e0293e3 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:24.314973 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9c5db03c-e6e0-4de0-a2e1-44fe8e0293e3 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:24.315412 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9c5db03c-e6e0-4de0-a2e1-44fe8e0293e3 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:24.315826 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9c5db03c-e6e0-4de0-a2e1-44fe8e0293e3 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:24.381744 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-9c5db03c-e6e0-4de0-a2e1-44fe8e0293e3 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:24.389642 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-9c5db03c-e6e0-4de0-a2e1-44fe8e0293e3 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1217 microversion: 2.1 time: 0.089148 Sep 16 01:54:24.403961 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 48/88] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:24 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1217 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:24.417883 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-66ec6215-77e1-42e6-abf0-42165ecde286 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:24.418499 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-66ec6215-77e1-42e6-abf0-42165ecde286 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:24.425303 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-66ec6215-77e1-42e6-abf0-42165ecde286 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:24.425819 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-66ec6215-77e1-42e6-abf0-42165ecde286 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:24.426262 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-66ec6215-77e1-42e6-abf0-42165ecde286 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:24.426956 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-66ec6215-77e1-42e6-abf0-42165ecde286 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:24.427480 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-66ec6215-77e1-42e6-abf0-42165ecde286 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:24.428262 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-66ec6215-77e1-42e6-abf0-42165ecde286 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:24.493497 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-66ec6215-77e1-42e6-abf0-42165ecde286 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:24.503357 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-66ec6215-77e1-42e6-abf0-42165ecde286 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1234 microversion: 2.1 time: 0.089583 Sep 16 01:54:24.503930 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 41/89] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:24 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1234 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:24.990176 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-62fbde40-b502-4431-8207-d154bb7a90ff tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:24.995337 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-62fbde40-b502-4431-8207-d154bb7a90ff tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:24.997760 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell0:SELECT=4 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:25.011082 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-62fbde40-b502-4431-8207-d154bb7a90ff tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:25.013759 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-62fbde40-b502-4431-8207-d154bb7a90ff tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:25.015878 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-62fbde40-b502-4431-8207-d154bb7a90ff tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:25.018042 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-62fbde40-b502-4431-8207-d154bb7a90ff tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:25.021090 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-62fbde40-b502-4431-8207-d154bb7a90ff tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:25.023789 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-62fbde40-b502-4431-8207-d154bb7a90ff tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:25.119922 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-62fbde40-b502-4431-8207-d154bb7a90ff tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:25.130508 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-62fbde40-b502-4431-8207-d154bb7a90ff tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:25.132642 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-62fbde40-b502-4431-8207-d154bb7a90ff tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:25.133762 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-62fbde40-b502-4431-8207-d154bb7a90ff tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1334 microversion: 2.20 time: 0.147403 Sep 16 01:54:25.134306 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 49/90] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:54:24 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1334 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:54:25.290554 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-fb5ed926-a239-4df8-bb92-68ad7dcfbf0c tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:25.291298 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-fb5ed926-a239-4df8-bb92-68ad7dcfbf0c tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] [instance: 33b0ab06-b40e-4c13-a33f-cd6a2881fd16] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:25.300062 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell0:SELECT=8 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:25.301879 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-fb5ed926-a239-4df8-bb92-68ad7dcfbf0c tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:25.305227 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-fb5ed926-a239-4df8-bb92-68ad7dcfbf0c tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:25.321619 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-fb5ed926-a239-4df8-bb92-68ad7dcfbf0c tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:25.323142 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-fb5ed926-a239-4df8-bb92-68ad7dcfbf0c tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:25.323828 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-fb5ed926-a239-4df8-bb92-68ad7dcfbf0c tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:25.324479 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-fb5ed926-a239-4df8-bb92-68ad7dcfbf0c tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:25.415700 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-fb1ccebb-1214-4411-969e-016afd9803a5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:25.416341 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-fb1ccebb-1214-4411-969e-016afd9803a5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:25.418181 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell0:SELECT=32 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:25.438086 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fb1ccebb-1214-4411-969e-016afd9803a5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:25.438654 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fb1ccebb-1214-4411-969e-016afd9803a5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:25.439256 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fb1ccebb-1214-4411-969e-016afd9803a5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:25.440197 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fb1ccebb-1214-4411-969e-016afd9803a5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:25.440823 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fb1ccebb-1214-4411-969e-016afd9803a5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:25.441246 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fb1ccebb-1214-4411-969e-016afd9803a5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:25.562317 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-fb1ccebb-1214-4411-969e-016afd9803a5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:25.571457 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-fb1ccebb-1214-4411-969e-016afd9803a5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1217 microversion: 2.1 time: 0.160516 Sep 16 01:54:25.585652 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 50/91] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:25 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1217 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:25.594316 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-06e2e17e-1e50-4fc2-8667-e1e977be582f tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:25.595559 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-06e2e17e-1e50-4fc2-8667-e1e977be582f tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:25.602735 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-06e2e17e-1e50-4fc2-8667-e1e977be582f tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:25.603444 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-06e2e17e-1e50-4fc2-8667-e1e977be582f tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:25.603885 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-06e2e17e-1e50-4fc2-8667-e1e977be582f tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:25.604609 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-06e2e17e-1e50-4fc2-8667-e1e977be582f tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:25.605319 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-06e2e17e-1e50-4fc2-8667-e1e977be582f tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:25.605936 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-06e2e17e-1e50-4fc2-8667-e1e977be582f tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:25.691297 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-06e2e17e-1e50-4fc2-8667-e1e977be582f tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:25.692725 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-fb5ed926-a239-4df8-bb92-68ad7dcfbf0c tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a39440ed016445a7bfc7ac7fba6661f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477dd0575c8741b0815ddf5f22297db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:25.701234 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-fb5ed926-a239-4df8-bb92-68ad7dcfbf0c tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] 10.222.0.42 "GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16" status: 200 len: 1315 microversion: 2.1 time: 0.415348 Sep 16 01:54:25.702204 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-06e2e17e-1e50-4fc2-8667-e1e977be582f tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1290 microversion: 2.1 time: 0.115027 Sep 16 01:54:25.703559 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 51/92] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:25 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1290 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:25.717678 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 42/93] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:25 2022] GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16 => generated 1315 bytes in 433 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:26.166141 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-5bc4faa1-939e-47ed-adfb-a4331bcad48d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:26.170515 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-5bc4faa1-939e-47ed-adfb-a4331bcad48d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:26.179595 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5bc4faa1-939e-47ed-adfb-a4331bcad48d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:26.180758 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5bc4faa1-939e-47ed-adfb-a4331bcad48d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:26.181764 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5bc4faa1-939e-47ed-adfb-a4331bcad48d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:26.185769 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5bc4faa1-939e-47ed-adfb-a4331bcad48d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:26.186704 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5bc4faa1-939e-47ed-adfb-a4331bcad48d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:26.187799 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5bc4faa1-939e-47ed-adfb-a4331bcad48d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:26.599263 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-f379ae4e-e721-4f81-bcfd-2b6151050470 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:26.600015 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-f379ae4e-e721-4f81-bcfd-2b6151050470 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:26.605817 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-5bc4faa1-939e-47ed-adfb-a4331bcad48d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:26.621912 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-5bc4faa1-939e-47ed-adfb-a4331bcad48d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:26.622506 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f379ae4e-e721-4f81-bcfd-2b6151050470 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:26.623299 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f379ae4e-e721-4f81-bcfd-2b6151050470 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:26.623434 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-5bc4faa1-939e-47ed-adfb-a4331bcad48d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:26.624478 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-5bc4faa1-939e-47ed-adfb-a4331bcad48d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1340 microversion: 2.20 time: 0.465429 Sep 16 01:54:26.624725 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f379ae4e-e721-4f81-bcfd-2b6151050470 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:26.625035 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 52/94] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:54:26 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1340 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 01:54:26.628740 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f379ae4e-e721-4f81-bcfd-2b6151050470 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:26.629404 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f379ae4e-e721-4f81-bcfd-2b6151050470 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:26.631499 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f379ae4e-e721-4f81-bcfd-2b6151050470 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:26.728631 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-7ec7b148-a1b0-4c1d-85cf-6e8c92c6aee0 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:26.729730 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-7ec7b148-a1b0-4c1d-85cf-6e8c92c6aee0 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:26.741881 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7ec7b148-a1b0-4c1d-85cf-6e8c92c6aee0 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:26.744338 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7ec7b148-a1b0-4c1d-85cf-6e8c92c6aee0 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:26.744931 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7ec7b148-a1b0-4c1d-85cf-6e8c92c6aee0 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:26.748972 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7ec7b148-a1b0-4c1d-85cf-6e8c92c6aee0 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:26.750229 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7ec7b148-a1b0-4c1d-85cf-6e8c92c6aee0 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:26.751922 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7ec7b148-a1b0-4c1d-85cf-6e8c92c6aee0 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:26.763707 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-f379ae4e-e721-4f81-bcfd-2b6151050470 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:26.774701 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-f379ae4e-e721-4f81-bcfd-2b6151050470 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1217 microversion: 2.1 time: 0.180871 Sep 16 01:54:26.776306 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 43/95] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:26 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1217 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 01:54:26.788647 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-e681ec63-c58a-43a1-a6e8-e703e63077de tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:26.789588 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-e681ec63-c58a-43a1-a6e8-e703e63077de tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] [instance: 33b0ab06-b40e-4c13-a33f-cd6a2881fd16] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:26.802669 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e681ec63-c58a-43a1-a6e8-e703e63077de tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:26.806973 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e681ec63-c58a-43a1-a6e8-e703e63077de tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:26.807821 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e681ec63-c58a-43a1-a6e8-e703e63077de tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:26.809053 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e681ec63-c58a-43a1-a6e8-e703e63077de tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:26.809594 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e681ec63-c58a-43a1-a6e8-e703e63077de tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:26.810672 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e681ec63-c58a-43a1-a6e8-e703e63077de tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:26.902866 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-7ec7b148-a1b0-4c1d-85cf-6e8c92c6aee0 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:26.921686 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-7ec7b148-a1b0-4c1d-85cf-6e8c92c6aee0 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1296 microversion: 2.1 time: 0.199726 Sep 16 01:54:26.922266 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 53/96] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:26 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1296 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 01:54:27.289881 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-e681ec63-c58a-43a1-a6e8-e703e63077de tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a39440ed016445a7bfc7ac7fba6661f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477dd0575c8741b0815ddf5f22297db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:27.299072 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-e681ec63-c58a-43a1-a6e8-e703e63077de tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] 10.222.0.42 "GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16" status: 200 len: 1315 microversion: 2.1 time: 0.520706 Sep 16 01:54:27.305757 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 44/97] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:26 2022] GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16 => generated 1315 bytes in 528 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:27.654369 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-e860dbc1-a23d-4661-95af-438cb29dcf9b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:27.655549 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-e860dbc1-a23d-4661-95af-438cb29dcf9b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:27.663610 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e860dbc1-a23d-4661-95af-438cb29dcf9b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:27.664424 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e860dbc1-a23d-4661-95af-438cb29dcf9b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:27.664855 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e860dbc1-a23d-4661-95af-438cb29dcf9b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:27.665544 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e860dbc1-a23d-4661-95af-438cb29dcf9b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:27.665992 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e860dbc1-a23d-4661-95af-438cb29dcf9b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:27.666406 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e860dbc1-a23d-4661-95af-438cb29dcf9b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:27.809092 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-7916b7fb-0d14-4db9-9387-9f7b68185ad6 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:27.809701 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-7916b7fb-0d14-4db9-9387-9f7b68185ad6 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:27.819407 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7916b7fb-0d14-4db9-9387-9f7b68185ad6 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:27.819926 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7916b7fb-0d14-4db9-9387-9f7b68185ad6 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:27.820385 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7916b7fb-0d14-4db9-9387-9f7b68185ad6 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:27.824249 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7916b7fb-0d14-4db9-9387-9f7b68185ad6 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:27.826218 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7916b7fb-0d14-4db9-9387-9f7b68185ad6 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:27.827001 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7916b7fb-0d14-4db9-9387-9f7b68185ad6 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:27.942971 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-7916b7fb-0d14-4db9-9387-9f7b68185ad6 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:27.960838 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-7916b7fb-0d14-4db9-9387-9f7b68185ad6 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1273 microversion: 2.1 time: 0.153306 Sep 16 01:54:27.963834 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 45/98] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:27 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1273 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:27.974839 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-acb253ca-b528-4edc-a317-aa6c88c780b4 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:27.977274 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-acb253ca-b528-4edc-a317-aa6c88c780b4 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:27.987522 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-acb253ca-b528-4edc-a317-aa6c88c780b4 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:27.988649 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-acb253ca-b528-4edc-a317-aa6c88c780b4 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:27.990296 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-acb253ca-b528-4edc-a317-aa6c88c780b4 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:27.992029 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-acb253ca-b528-4edc-a317-aa6c88c780b4 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:27.992770 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-acb253ca-b528-4edc-a317-aa6c88c780b4 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:27.994164 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-acb253ca-b528-4edc-a317-aa6c88c780b4 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:28.172400 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-acb253ca-b528-4edc-a317-aa6c88c780b4 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:28.199160 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-acb253ca-b528-4edc-a317-aa6c88c780b4 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1296 microversion: 2.1 time: 0.233841 Sep 16 01:54:28.200311 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 46/99] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:27 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1296 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:28.315911 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-e860dbc1-a23d-4661-95af-438cb29dcf9b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:28.330377 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-a0e9f975-999c-4844-b49a-3e69f5ac2fed tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:28.331720 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-a0e9f975-999c-4844-b49a-3e69f5ac2fed tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] [instance: 33b0ab06-b40e-4c13-a33f-cd6a2881fd16] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:28.344788 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a0e9f975-999c-4844-b49a-3e69f5ac2fed tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:28.345544 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a0e9f975-999c-4844-b49a-3e69f5ac2fed tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:28.345808 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-e860dbc1-a23d-4661-95af-438cb29dcf9b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:28.346680 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a0e9f975-999c-4844-b49a-3e69f5ac2fed tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:28.347995 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a0e9f975-999c-4844-b49a-3e69f5ac2fed tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:28.348106 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-e860dbc1-a23d-4661-95af-438cb29dcf9b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:28.350199 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a0e9f975-999c-4844-b49a-3e69f5ac2fed tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:28.351589 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a0e9f975-999c-4844-b49a-3e69f5ac2fed tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:28.354889 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-e860dbc1-a23d-4661-95af-438cb29dcf9b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1408 microversion: 2.20 time: 0.705212 Sep 16 01:54:28.355982 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 54/100] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:54:27 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1408 bytes in 708 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:54:28.527055 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-a0e9f975-999c-4844-b49a-3e69f5ac2fed tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a39440ed016445a7bfc7ac7fba6661f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477dd0575c8741b0815ddf5f22297db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:28.538618 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-a0e9f975-999c-4844-b49a-3e69f5ac2fed tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] 10.222.0.42 "GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16" status: 200 len: 1315 microversion: 2.1 time: 0.213716 Sep 16 01:54:28.539600 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 47/101] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:28 2022] GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16 => generated 1315 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 01:54:28.993770 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-59f382d4-239d-4634-b91a-cb08ecc65938 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:28.995067 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-59f382d4-239d-4634-b91a-cb08ecc65938 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:29.001736 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-59f382d4-239d-4634-b91a-cb08ecc65938 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:29.007446 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-59f382d4-239d-4634-b91a-cb08ecc65938 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:29.008205 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-59f382d4-239d-4634-b91a-cb08ecc65938 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:29.009509 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-59f382d4-239d-4634-b91a-cb08ecc65938 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:29.010154 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-59f382d4-239d-4634-b91a-cb08ecc65938 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:29.010774 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-59f382d4-239d-4634-b91a-cb08ecc65938 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:29.162736 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-59f382d4-239d-4634-b91a-cb08ecc65938 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:29.171095 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-59f382d4-239d-4634-b91a-cb08ecc65938 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1273 microversion: 2.1 time: 0.181982 Sep 16 01:54:29.172125 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 55/102] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:28 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1273 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:29.223199 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-f4e19a20-21f4-4abe-a0df-054f802368c6 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:29.223815 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-f4e19a20-21f4-4abe-a0df-054f802368c6 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:29.235142 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_api:SELECT=91,nova_api:INSERT=9 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:29.239037 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f4e19a20-21f4-4abe-a0df-054f802368c6 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:29.240761 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f4e19a20-21f4-4abe-a0df-054f802368c6 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:29.243040 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f4e19a20-21f4-4abe-a0df-054f802368c6 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:29.246090 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f4e19a20-21f4-4abe-a0df-054f802368c6 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:29.246768 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f4e19a20-21f4-4abe-a0df-054f802368c6 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:29.248751 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f4e19a20-21f4-4abe-a0df-054f802368c6 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:29.356480 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-f4e19a20-21f4-4abe-a0df-054f802368c6 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:29.370989 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-f4e19a20-21f4-4abe-a0df-054f802368c6 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1296 microversion: 2.1 time: 0.147999 Sep 16 01:54:29.370989 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 48/103] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:29 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1296 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:29.381556 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-05f58bab-6c25-4a60-bb8c-7021a890f8da tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:29.382400 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-05f58bab-6c25-4a60-bb8c-7021a890f8da tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:29.389268 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-05f58bab-6c25-4a60-bb8c-7021a890f8da tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:29.389863 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-05f58bab-6c25-4a60-bb8c-7021a890f8da tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:29.390414 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-05f58bab-6c25-4a60-bb8c-7021a890f8da tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:29.391184 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-05f58bab-6c25-4a60-bb8c-7021a890f8da tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:29.391708 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-05f58bab-6c25-4a60-bb8c-7021a890f8da tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:29.392546 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-05f58bab-6c25-4a60-bb8c-7021a890f8da tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:29.590445 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-05f58bab-6c25-4a60-bb8c-7021a890f8da tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:29.601990 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-05f58bab-6c25-4a60-bb8c-7021a890f8da tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:29.603767 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-05f58bab-6c25-4a60-bb8c-7021a890f8da tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:29.605382 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-05f58bab-6c25-4a60-bb8c-7021a890f8da tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1408 microversion: 2.20 time: 0.228907 Sep 16 01:54:29.607207 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 49/104] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:54:29 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1408 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 01:54:29.624847 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-57dad5fd-71bf-40e7-971c-e7cc2a233192 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:29.625618 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-57dad5fd-71bf-40e7-971c-e7cc2a233192 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] [instance: 33b0ab06-b40e-4c13-a33f-cd6a2881fd16] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:29.645376 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-57dad5fd-71bf-40e7-971c-e7cc2a233192 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:29.647795 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-57dad5fd-71bf-40e7-971c-e7cc2a233192 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:29.648476 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-57dad5fd-71bf-40e7-971c-e7cc2a233192 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:29.650796 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-57dad5fd-71bf-40e7-971c-e7cc2a233192 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:29.651484 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-57dad5fd-71bf-40e7-971c-e7cc2a233192 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:29.654388 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-57dad5fd-71bf-40e7-971c-e7cc2a233192 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:29.745976 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-f47ed0a1-e974-4e13-a87c-60b27eee235c tempest-VolumesNegativeTest-1383864273 tempest-VolumesNegativeTest-1383864273-project] Action: 'create', calling method: .version_select at 0x7fae32e2a280>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1807057127", "metadata": {"Type": "work"}}} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:54:29.766905 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-f47ed0a1-e974-4e13-a87c-60b27eee235c tempest-VolumesNegativeTest-1383864273 tempest-VolumesNegativeTest-1383864273-project] Request method failure captured: Sep 16 01:54:29.766905 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 16 01:54:29.766905 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Accept: application/json Sep 16 01:54:29.766905 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Accept-Encoding: identity Sep 16 01:54:29.766905 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Connection: close Sep 16 01:54:29.766905 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Content-Length: 122 Sep 16 01:54:29.766905 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Content-Type: application/json Sep 16 01:54:29.766905 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Host: 10.222.0.42 Sep 16 01:54:29.766905 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Openstack-System-Scope: None Sep 16 01:54:29.766905 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: User-Agent: python-urllib3/1.26.12 Sep 16 01:54:29.766905 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Auth-Token: gAAAAABjI9dVUO9dIoGbe8sJlhxVUKNQ2YfHpnTFwL5HNPaSLeVJZPgR66dVkzaZroZXbmw94f1WtI32mOwbFq--Rs4xj3b4ensXKuPlklfwSE1kkxnXfKQeGwcOdjCaBY0cUGDeRqNK-j8rm5-M5fhKKOXZW8JSR3ewmlW6ZhfIDAx5U6QyvkE Sep 16 01:54:29.766905 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Domain-Id: None Sep 16 01:54:29.766905 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Domain-Name: None Sep 16 01:54:29.766905 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Identity-Status: Confirmed Sep 16 01:54:29.766905 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Is-Admin-Project: True Sep 16 01:54:29.766905 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Domain-Id: default Sep 16 01:54:29.766905 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Domain-Name: Default Sep 16 01:54:29.766905 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Id: fa5c663186bc4b1d853726a52f70636e Sep 16 01:54:29.766905 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Name: tempest-VolumesNegativeTest-1383864273 Sep 16 01:54:29.766905 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Role: member,reader Sep 16 01:54:29.766905 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Roles: member,reader Sep 16 01:54:29.768470 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/fa5c663186bc4b1d853726a52f70636e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fa5c663186bc4b1d853726a52f70636e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_fa5c663186bc4b1d853726a52f70636e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fa5c663186bc4b1d853726a52f70636e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 01:54:29.768470 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant: tempest-VolumesNegativeTest-1383864273 Sep 16 01:54:29.768470 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant-Id: fa5c663186bc4b1d853726a52f70636e Sep 16 01:54:29.768470 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant-Name: tempest-VolumesNegativeTest-1383864273 Sep 16 01:54:29.768470 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User: tempest-VolumesNegativeTest-1383864273-project Sep 16 01:54:29.768470 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Domain-Id: default Sep 16 01:54:29.768470 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Domain-Name: Default Sep 16 01:54:29.768470 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Id: a9620b4f6e0644f9ac7b4a543dc18578 Sep 16 01:54:29.768470 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Name: tempest-VolumesNegativeTest-1383864273-project Sep 16 01:54:29.768470 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Sep 16 01:54:29.768470 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-1807057127", "metadata": {"Type": "work"}}} Sep 16 01:54:29.768470 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: method: Sep 16 01:54:29.768470 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 16 01:54:29.769175 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-1807057127', 'metadata': {'Type': 'work'}}}} Sep 16 01:54:29.769175 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 01:54:29.769175 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:54:29.769175 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 01:54:29.769175 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 01:54:29.769175 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 01:54:29.769175 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise error Sep 16 01:54:29.769175 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 16 01:54:29.769175 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:54:29.769175 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 16 01:54:29.769175 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 16 01:54:29.769175 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:54:29.769175 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 16 01:54:29.769175 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi '#$%' Sep 16 01:54:29.769175 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:54:29.769175 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:54:29.769175 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:54:29.769175 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:54:29.769175 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 01:54:29.769175 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 01:54:29.769175 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 01:54:29.769175 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 01:54:29.770368 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 01:54:29.770368 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 01:54:29.770368 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 01:54:29.770368 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 01:54:29.770368 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 01:54:29.770368 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 01:54:29.770368 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 01:54:29.770368 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 01:54:29.770368 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 01:54:29.770368 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 01:54:29.770368 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 16 01:54:29.770368 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:54:29.770368 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:54:29.770368 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:54:29.770368 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:54:29.770368 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 01:54:29.770368 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 01:54:29.770368 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 01:54:29.770368 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 01:54:29.771680 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 16 01:54:29.771680 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:54:29.771680 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-f47ed0a1-e974-4e13-a87c-60b27eee235c tempest-VolumesNegativeTest-1383864273 tempest-VolumesNegativeTest-1383864273-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=120441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 01:54:29.771680 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-f47ed0a1-e974-4e13-a87c-60b27eee235c tempest-VolumesNegativeTest-1383864273 tempest-VolumesNegativeTest-1383864273-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.414047 Sep 16 01:54:29.771680 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 56/105] 10.222.0.42 () {60 vars in 1156 bytes} [Fri Sep 16 01:54:29 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 415 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 01:54:29.785930 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-ab3a303f-ab72-482b-81c0-302207807b34 tempest-VolumesNegativeTest-1383864273 tempest-VolumesNegativeTest-1383864273-project] Action: 'create', calling method: .version_select at 0x7fae33678280>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-270271614", "metadata": {"Type": "work"}}} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:54:29.795407 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-ab3a303f-ab72-482b-81c0-302207807b34 tempest-VolumesNegativeTest-1383864273 tempest-VolumesNegativeTest-1383864273-project] Request method failure captured: Sep 16 01:54:29.795407 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 16 01:54:29.795407 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Accept: application/json Sep 16 01:54:29.795407 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Accept-Encoding: identity Sep 16 01:54:29.795407 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Connection: close Sep 16 01:54:29.795407 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Content-Length: 119 Sep 16 01:54:29.795407 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Content-Type: application/json Sep 16 01:54:29.795407 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Host: 10.222.0.42 Sep 16 01:54:29.795407 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Openstack-System-Scope: None Sep 16 01:54:29.795407 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: User-Agent: python-urllib3/1.26.12 Sep 16 01:54:29.795407 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Auth-Token: gAAAAABjI9dVUO9dIoGbe8sJlhxVUKNQ2YfHpnTFwL5HNPaSLeVJZPgR66dVkzaZroZXbmw94f1WtI32mOwbFq--Rs4xj3b4ensXKuPlklfwSE1kkxnXfKQeGwcOdjCaBY0cUGDeRqNK-j8rm5-M5fhKKOXZW8JSR3ewmlW6ZhfIDAx5U6QyvkE Sep 16 01:54:29.795407 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Domain-Id: None Sep 16 01:54:29.795407 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Domain-Name: None Sep 16 01:54:29.795407 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Identity-Status: Confirmed Sep 16 01:54:29.795407 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Is-Admin-Project: True Sep 16 01:54:29.795407 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Domain-Id: default Sep 16 01:54:29.795407 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Domain-Name: Default Sep 16 01:54:29.795407 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Id: fa5c663186bc4b1d853726a52f70636e Sep 16 01:54:29.795407 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Name: tempest-VolumesNegativeTest-1383864273 Sep 16 01:54:29.795407 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Role: member,reader Sep 16 01:54:29.795407 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Roles: member,reader Sep 16 01:54:29.796856 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/fa5c663186bc4b1d853726a52f70636e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fa5c663186bc4b1d853726a52f70636e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_fa5c663186bc4b1d853726a52f70636e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fa5c663186bc4b1d853726a52f70636e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 01:54:29.796856 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant: tempest-VolumesNegativeTest-1383864273 Sep 16 01:54:29.796856 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant-Id: fa5c663186bc4b1d853726a52f70636e Sep 16 01:54:29.796856 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant-Name: tempest-VolumesNegativeTest-1383864273 Sep 16 01:54:29.796856 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User: tempest-VolumesNegativeTest-1383864273-project Sep 16 01:54:29.796856 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Domain-Id: default Sep 16 01:54:29.796856 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Domain-Name: Default Sep 16 01:54:29.796856 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Id: a9620b4f6e0644f9ac7b4a543dc18578 Sep 16 01:54:29.796856 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Name: tempest-VolumesNegativeTest-1383864273-project Sep 16 01:54:29.796856 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Sep 16 01:54:29.796856 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-270271614", "metadata": {"Type": "work"}}} Sep 16 01:54:29.796856 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: method: Sep 16 01:54:29.796856 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 16 01:54:29.797545 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-270271614', 'metadata': {'Type': 'work'}}}} Sep 16 01:54:29.797545 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 01:54:29.797545 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:54:29.797545 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 01:54:29.797545 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 01:54:29.797545 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 01:54:29.797545 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise error Sep 16 01:54:29.797545 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 16 01:54:29.797545 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:54:29.797545 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 16 01:54:29.797545 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 16 01:54:29.797545 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:54:29.797545 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 16 01:54:29.797545 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi '0' Sep 16 01:54:29.797545 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:54:29.797545 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:54:29.797545 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:54:29.797545 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:54:29.797545 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 01:54:29.797545 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 01:54:29.797545 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 01:54:29.797545 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 01:54:29.798659 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 01:54:29.798659 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 01:54:29.798659 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 01:54:29.798659 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 01:54:29.798659 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 01:54:29.798659 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 01:54:29.798659 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 01:54:29.798659 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 01:54:29.798659 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 01:54:29.798659 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 01:54:29.798659 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 16 01:54:29.798659 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:54:29.798659 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:54:29.798659 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:54:29.798659 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:54:29.798659 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 01:54:29.798659 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 01:54:29.798659 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 01:54:29.798659 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 01:54:29.801064 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 16 01:54:29.801064 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:54:29.803098 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-ab3a303f-ab72-482b-81c0-302207807b34 tempest-VolumesNegativeTest-1383864273 tempest-VolumesNegativeTest-1383864273-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=120441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 01:54:29.804587 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-ab3a303f-ab72-482b-81c0-302207807b34 tempest-VolumesNegativeTest-1383864273 tempest-VolumesNegativeTest-1383864273-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.023121 Sep 16 01:54:29.806002 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 57/106] 10.222.0.42 () {60 vars in 1156 bytes} [Fri Sep 16 01:54:29 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 26 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 01:54:29.817301 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-14efc46e-eabf-4d90-8d5b-22d357c79ebf tempest-VolumesNegativeTest-1383864273 tempest-VolumesNegativeTest-1383864273-project] Action: 'create', calling method: .version_select at 0x7fae32e2a280>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-944662276", "metadata": {"Type": "work"}}} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:54:29.822918 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-14efc46e-eabf-4d90-8d5b-22d357c79ebf tempest-VolumesNegativeTest-1383864273 tempest-VolumesNegativeTest-1383864273-project] Request method failure captured: Sep 16 01:54:29.822918 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 16 01:54:29.822918 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Accept: application/json Sep 16 01:54:29.822918 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Accept-Encoding: identity Sep 16 01:54:29.822918 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Connection: close Sep 16 01:54:29.822918 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Content-Length: 118 Sep 16 01:54:29.822918 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Content-Type: application/json Sep 16 01:54:29.822918 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Host: 10.222.0.42 Sep 16 01:54:29.822918 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Openstack-System-Scope: None Sep 16 01:54:29.822918 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: User-Agent: python-urllib3/1.26.12 Sep 16 01:54:29.822918 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Auth-Token: gAAAAABjI9dVUO9dIoGbe8sJlhxVUKNQ2YfHpnTFwL5HNPaSLeVJZPgR66dVkzaZroZXbmw94f1WtI32mOwbFq--Rs4xj3b4ensXKuPlklfwSE1kkxnXfKQeGwcOdjCaBY0cUGDeRqNK-j8rm5-M5fhKKOXZW8JSR3ewmlW6ZhfIDAx5U6QyvkE Sep 16 01:54:29.822918 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Domain-Id: None Sep 16 01:54:29.822918 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Domain-Name: None Sep 16 01:54:29.822918 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Identity-Status: Confirmed Sep 16 01:54:29.822918 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Is-Admin-Project: True Sep 16 01:54:29.822918 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Domain-Id: default Sep 16 01:54:29.822918 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Domain-Name: Default Sep 16 01:54:29.822918 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Id: fa5c663186bc4b1d853726a52f70636e Sep 16 01:54:29.822918 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Name: tempest-VolumesNegativeTest-1383864273 Sep 16 01:54:29.822918 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Role: member,reader Sep 16 01:54:29.822918 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Roles: member,reader Sep 16 01:54:29.824055 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/fa5c663186bc4b1d853726a52f70636e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fa5c663186bc4b1d853726a52f70636e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_fa5c663186bc4b1d853726a52f70636e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fa5c663186bc4b1d853726a52f70636e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 01:54:29.824055 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant: tempest-VolumesNegativeTest-1383864273 Sep 16 01:54:29.824055 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant-Id: fa5c663186bc4b1d853726a52f70636e Sep 16 01:54:29.824055 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant-Name: tempest-VolumesNegativeTest-1383864273 Sep 16 01:54:29.824055 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User: tempest-VolumesNegativeTest-1383864273-project Sep 16 01:54:29.824055 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Domain-Id: default Sep 16 01:54:29.824055 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Domain-Name: Default Sep 16 01:54:29.824055 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Id: a9620b4f6e0644f9ac7b4a543dc18578 Sep 16 01:54:29.824055 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Name: tempest-VolumesNegativeTest-1383864273-project Sep 16 01:54:29.824055 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Sep 16 01:54:29.824055 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-944662276", "metadata": {"Type": "work"}}} Sep 16 01:54:29.824055 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: method: Sep 16 01:54:29.824055 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 16 01:54:29.824758 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-944662276', 'metadata': {'Type': 'work'}}}} Sep 16 01:54:29.824758 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 01:54:29.824758 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:54:29.824758 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 01:54:29.824758 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 01:54:29.824758 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 01:54:29.824758 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise error Sep 16 01:54:29.824758 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 16 01:54:29.824758 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:54:29.824758 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 16 01:54:29.824758 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 16 01:54:29.824758 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:54:29.824758 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 16 01:54:29.824758 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi '' Sep 16 01:54:29.824758 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:54:29.824758 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:54:29.824758 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:54:29.824758 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:54:29.824758 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 01:54:29.824758 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 01:54:29.824758 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 01:54:29.824758 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 01:54:29.825876 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 01:54:29.825876 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 01:54:29.825876 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 01:54:29.825876 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 01:54:29.825876 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 01:54:29.825876 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 01:54:29.825876 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 01:54:29.825876 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 01:54:29.825876 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 01:54:29.825876 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 01:54:29.825876 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 16 01:54:29.825876 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:54:29.825876 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:54:29.825876 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:54:29.825876 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:54:29.825876 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 01:54:29.825876 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 01:54:29.825876 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 01:54:29.825876 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 01:54:29.827468 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 16 01:54:29.827468 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:54:29.828901 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-14efc46e-eabf-4d90-8d5b-22d357c79ebf tempest-VolumesNegativeTest-1383864273 tempest-VolumesNegativeTest-1383864273-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=120441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 01:54:29.829968 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-14efc46e-eabf-4d90-8d5b-22d357c79ebf tempest-VolumesNegativeTest-1383864273 tempest-VolumesNegativeTest-1383864273-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.018981 Sep 16 01:54:29.831109 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 58/107] 10.222.0.42 () {60 vars in 1156 bytes} [Fri Sep 16 01:54:29 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 01:54:29.848562 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-718ca4f1-24df-4182-9e32-a51d257f386b tempest-VolumesNegativeTest-1383864273 tempest-VolumesNegativeTest-1383864273-project] Calling method '.version_select at 0x7fae32e4f8b0>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:29.882834 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.wsgi [None req-718ca4f1-24df-4182-9e32-a51d257f386b tempest-VolumesNegativeTest-1383864273 tempest-VolumesNegativeTest-1383864273-project] HTTP exception thrown: Volume tempest-invalid-498261663 could not be found. Sep 16 01:54:29.885407 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-718ca4f1-24df-4182-9e32-a51d257f386b tempest-VolumesNegativeTest-1383864273 tempest-VolumesNegativeTest-1383864273-project] Request method failure captured: Sep 16 01:54:29.885407 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-498261663 HTTP/1.1 Sep 16 01:54:29.885407 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Accept: application/json Sep 16 01:54:29.885407 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Accept-Encoding: identity Sep 16 01:54:29.885407 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Connection: close Sep 16 01:54:29.885407 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Content-Length: 0 Sep 16 01:54:29.885407 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Content-Type: application/json Sep 16 01:54:29.885407 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Host: 10.222.0.42 Sep 16 01:54:29.885407 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Openstack-System-Scope: None Sep 16 01:54:29.885407 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: User-Agent: python-urllib3/1.26.12 Sep 16 01:54:29.885407 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Auth-Token: gAAAAABjI9dVUO9dIoGbe8sJlhxVUKNQ2YfHpnTFwL5HNPaSLeVJZPgR66dVkzaZroZXbmw94f1WtI32mOwbFq--Rs4xj3b4ensXKuPlklfwSE1kkxnXfKQeGwcOdjCaBY0cUGDeRqNK-j8rm5-M5fhKKOXZW8JSR3ewmlW6ZhfIDAx5U6QyvkE Sep 16 01:54:29.885407 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Domain-Id: None Sep 16 01:54:29.885407 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Domain-Name: None Sep 16 01:54:29.885407 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Identity-Status: Confirmed Sep 16 01:54:29.885407 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Is-Admin-Project: True Sep 16 01:54:29.885407 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Domain-Id: default Sep 16 01:54:29.885407 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Domain-Name: Default Sep 16 01:54:29.885407 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Id: fa5c663186bc4b1d853726a52f70636e Sep 16 01:54:29.885407 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Name: tempest-VolumesNegativeTest-1383864273 Sep 16 01:54:29.885407 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Role: member,reader Sep 16 01:54:29.885407 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Roles: member,reader Sep 16 01:54:29.886805 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/fa5c663186bc4b1d853726a52f70636e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fa5c663186bc4b1d853726a52f70636e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_fa5c663186bc4b1d853726a52f70636e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fa5c663186bc4b1d853726a52f70636e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 01:54:29.886805 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant: tempest-VolumesNegativeTest-1383864273 Sep 16 01:54:29.886805 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant-Id: fa5c663186bc4b1d853726a52f70636e Sep 16 01:54:29.886805 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant-Name: tempest-VolumesNegativeTest-1383864273 Sep 16 01:54:29.886805 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User: tempest-VolumesNegativeTest-1383864273-project Sep 16 01:54:29.886805 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Domain-Id: default Sep 16 01:54:29.886805 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Domain-Name: Default Sep 16 01:54:29.886805 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Id: a9620b4f6e0644f9ac7b4a543dc18578 Sep 16 01:54:29.886805 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Name: tempest-VolumesNegativeTest-1383864273-project Sep 16 01:54:29.886805 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: method: Sep 16 01:54:29.886805 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: exception: Volume tempest-invalid-498261663 could not be found. Sep 16 01:54:29.886805 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: action_args: {'id': 'tempest-invalid-498261663'} Sep 16 01:54:29.886805 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 01:54:29.887583 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:54:29.887583 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 01:54:29.887583 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 01:54:29.887583 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 16 01:54:29.887583 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 16 01:54:29.887583 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 16 01:54:29.887583 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 16 01:54:29.887583 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 16 01:54:29.887583 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 16 01:54:29.887583 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 16 01:54:29.887583 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 16 01:54:29.887583 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 01:54:29.887583 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 01:54:29.887583 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 01:54:29.887583 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 01:54:29.887583 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-498261663 could not be found. (HTTP 404) (Request-ID: req-ad427969-a578-4b85-a195-92f513a43313) Sep 16 01:54:29.887583 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:54:29.887583 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:54:29.887583 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:54:29.888640 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:54:29.888640 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 16 01:54:29.888640 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 16 01:54:29.888640 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 16 01:54:29.888640 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 16 01:54:29.888640 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 16 01:54:29.888640 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 16 01:54:29.888640 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 16 01:54:29.888640 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 16 01:54:29.888640 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 01:54:29.888640 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 01:54:29.888640 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 16 01:54:29.888640 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 16 01:54:29.888640 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 16 01:54:29.888640 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 16 01:54:29.888640 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 16 01:54:29.888640 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 16 01:54:29.888640 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 16 01:54:29.888640 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 16 01:54:29.891332 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 01:54:29.891332 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 01:54:29.891332 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 01:54:29.891332 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 01:54:29.891332 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-498261663 could not be found. Sep 16 01:54:29.891332 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:54:29.891332 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:54:29.891332 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:54:29.891332 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:54:29.891332 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 01:54:29.891332 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 01:54:29.891332 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 01:54:29.891332 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 01:54:29.891332 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 01:54:29.891332 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 01:54:29.891332 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 01:54:29.891332 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 01:54:29.891332 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 16 01:54:29.891332 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 01:54:29.891332 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-498261663 could not be found. Sep 16 01:54:29.892406 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:54:29.892406 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:54:29.892406 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:54:29.892406 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:54:29.892406 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 01:54:29.892406 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 01:54:29.892406 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 01:54:29.892406 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 01:54:29.892406 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-498261663 could not be found. Sep 16 01:54:29.892406 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:54:29.892406 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-718ca4f1-24df-4182-9e32-a51d257f386b tempest-VolumesNegativeTest-1383864273 tempest-VolumesNegativeTest-1383864273-project] Returning 404 to user: Volume tempest-invalid-498261663 could not be found. {{(pid=120441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 01:54:29.892406 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-718ca4f1-24df-4182-9e32-a51d257f386b tempest-VolumesNegativeTest-1383864273 tempest-VolumesNegativeTest-1383864273-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/tempest-invalid-498261663" status: 404 len: 98 microversion: 2.1 time: 0.047311 Sep 16 01:54:29.892406 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 59/108] 10.222.0.42 () {58 vars in 1215 bytes} [Fri Sep 16 01:54:29 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-498261663 => generated 98 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Sep 16 01:54:29.910858 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-d38e0055-65f4-4323-9fcd-b630e344eed8 tempest-VolumesNegativeTest-1383864273 tempest-VolumesNegativeTest-1383864273-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.016256 Sep 16 01:54:29.916119 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 60/109] 10.222.0.42 () {58 vars in 1140 bytes} [Fri Sep 16 01:54:29 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 18 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 16 01:54:29.921274 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-57dad5fd-71bf-40e7-971c-e7cc2a233192 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a39440ed016445a7bfc7ac7fba6661f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477dd0575c8741b0815ddf5f22297db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:29.921425 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-981d2154-c8c7-4f34-a01b-a9df934c06fc tempest-VolumesNegativeTest-1383864273 tempest-VolumesNegativeTest-1383864273-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003995 Sep 16 01:54:29.921872 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 61/110] 10.222.0.42 () {58 vars in 1137 bytes} [Fri Sep 16 01:54:29 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (2 switches on core 0) Sep 16 01:54:29.932100 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-29b8354a-831e-4439-8c80-0d7328c3629b tempest-VolumesNegativeTest-1383864273 tempest-VolumesNegativeTest-1383864273-project] Calling method '.version_select at 0x7fae32e2af70>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:29.935071 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-57dad5fd-71bf-40e7-971c-e7cc2a233192 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] 10.222.0.42 "GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16" status: 200 len: 1315 microversion: 2.1 time: 0.326520 Sep 16 01:54:29.935666 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 50/111] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:29 2022] GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16 => generated 1315 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:29.969349 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.wsgi [None req-29b8354a-831e-4439-8c80-0d7328c3629b tempest-VolumesNegativeTest-1383864273 tempest-VolumesNegativeTest-1383864273-project] HTTP exception thrown: Volume 9f87fac7-9c36-4842-98e7-272ffff71ee2 could not be found. Sep 16 01:54:29.972051 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-29b8354a-831e-4439-8c80-0d7328c3629b tempest-VolumesNegativeTest-1383864273 tempest-VolumesNegativeTest-1383864273-project] Request method failure captured: Sep 16 01:54:29.972051 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: request: DELETE /compute/v2.1/os-volumes/9f87fac7-9c36-4842-98e7-272ffff71ee2 HTTP/1.1 Sep 16 01:54:29.972051 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Accept: application/json Sep 16 01:54:29.972051 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Accept-Encoding: identity Sep 16 01:54:29.972051 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Connection: close Sep 16 01:54:29.972051 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Content-Length: 0 Sep 16 01:54:29.972051 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Content-Type: application/json Sep 16 01:54:29.972051 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Host: 10.222.0.42 Sep 16 01:54:29.972051 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Openstack-System-Scope: None Sep 16 01:54:29.972051 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: User-Agent: python-urllib3/1.26.12 Sep 16 01:54:29.972051 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Auth-Token: gAAAAABjI9dVUO9dIoGbe8sJlhxVUKNQ2YfHpnTFwL5HNPaSLeVJZPgR66dVkzaZroZXbmw94f1WtI32mOwbFq--Rs4xj3b4ensXKuPlklfwSE1kkxnXfKQeGwcOdjCaBY0cUGDeRqNK-j8rm5-M5fhKKOXZW8JSR3ewmlW6ZhfIDAx5U6QyvkE Sep 16 01:54:29.972051 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Domain-Id: None Sep 16 01:54:29.972051 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Domain-Name: None Sep 16 01:54:29.972051 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Identity-Status: Confirmed Sep 16 01:54:29.972051 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Is-Admin-Project: True Sep 16 01:54:29.972051 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Domain-Id: default Sep 16 01:54:29.972051 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Domain-Name: Default Sep 16 01:54:29.972051 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Id: fa5c663186bc4b1d853726a52f70636e Sep 16 01:54:29.972051 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Name: tempest-VolumesNegativeTest-1383864273 Sep 16 01:54:29.972051 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Role: member,reader Sep 16 01:54:29.972051 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Roles: member,reader Sep 16 01:54:29.973150 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/fa5c663186bc4b1d853726a52f70636e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fa5c663186bc4b1d853726a52f70636e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_fa5c663186bc4b1d853726a52f70636e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fa5c663186bc4b1d853726a52f70636e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 01:54:29.973150 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant: tempest-VolumesNegativeTest-1383864273 Sep 16 01:54:29.973150 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant-Id: fa5c663186bc4b1d853726a52f70636e Sep 16 01:54:29.973150 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant-Name: tempest-VolumesNegativeTest-1383864273 Sep 16 01:54:29.973150 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User: tempest-VolumesNegativeTest-1383864273-project Sep 16 01:54:29.973150 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Domain-Id: default Sep 16 01:54:29.973150 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Domain-Name: Default Sep 16 01:54:29.973150 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Id: a9620b4f6e0644f9ac7b4a543dc18578 Sep 16 01:54:29.973150 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Name: tempest-VolumesNegativeTest-1383864273-project Sep 16 01:54:29.973150 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: method: Sep 16 01:54:29.973150 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: exception: Volume 9f87fac7-9c36-4842-98e7-272ffff71ee2 could not be found. Sep 16 01:54:29.973150 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: action_args: {'id': '9f87fac7-9c36-4842-98e7-272ffff71ee2'} Sep 16 01:54:29.973150 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 01:54:29.973811 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:54:29.973811 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 01:54:29.973811 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 01:54:29.973811 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 16 01:54:29.973811 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 16 01:54:29.973811 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 16 01:54:29.973811 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 16 01:54:29.973811 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 16 01:54:29.973811 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 16 01:54:29.973811 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 16 01:54:29.973811 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 16 01:54:29.973811 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 01:54:29.973811 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 01:54:29.973811 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 01:54:29.973811 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 01:54:29.973811 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9f87fac7-9c36-4842-98e7-272ffff71ee2 could not be found. (HTTP 404) (Request-ID: req-733bc101-aeb3-43b4-b0c1-f12ccc52530b) Sep 16 01:54:29.973811 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:54:29.973811 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:54:29.973811 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:54:29.975536 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:54:29.975536 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 16 01:54:29.975536 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 16 01:54:29.975536 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 16 01:54:29.975536 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 16 01:54:29.975536 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 16 01:54:29.975536 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 16 01:54:29.975536 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 16 01:54:29.975536 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 16 01:54:29.975536 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 01:54:29.975536 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 01:54:29.975536 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 16 01:54:29.975536 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 16 01:54:29.975536 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 16 01:54:29.975536 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 16 01:54:29.975536 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 16 01:54:29.975536 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 16 01:54:29.975536 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 16 01:54:29.975536 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 16 01:54:29.976574 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 01:54:29.976574 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 01:54:29.976574 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 01:54:29.976574 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 01:54:29.976574 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9f87fac7-9c36-4842-98e7-272ffff71ee2 could not be found. Sep 16 01:54:29.976574 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:54:29.976574 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:54:29.976574 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:54:29.976574 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:54:29.976574 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 01:54:29.976574 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 01:54:29.976574 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 01:54:29.976574 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 01:54:29.976574 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 01:54:29.976574 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 01:54:29.976574 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 01:54:29.976574 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 01:54:29.976574 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 16 01:54:29.976574 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 01:54:29.977513 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9f87fac7-9c36-4842-98e7-272ffff71ee2 could not be found. Sep 16 01:54:29.977513 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:54:29.977513 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:54:29.977513 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:54:29.977513 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:54:29.977513 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 01:54:29.977513 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 01:54:29.977513 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 01:54:29.977513 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 01:54:29.977513 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9f87fac7-9c36-4842-98e7-272ffff71ee2 could not be found. Sep 16 01:54:29.977513 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:54:29.977513 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-29b8354a-831e-4439-8c80-0d7328c3629b tempest-VolumesNegativeTest-1383864273 tempest-VolumesNegativeTest-1383864273-project] Returning 404 to user: Volume 9f87fac7-9c36-4842-98e7-272ffff71ee2 could not be found. {{(pid=120441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 01:54:29.977513 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-29b8354a-831e-4439-8c80-0d7328c3629b tempest-VolumesNegativeTest-1383864273 tempest-VolumesNegativeTest-1383864273-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/9f87fac7-9c36-4842-98e7-272ffff71ee2" status: 404 len: 109 microversion: 2.1 time: 0.047005 Sep 16 01:54:29.977513 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 62/112] 10.222.0.42 () {58 vars in 1248 bytes} [Fri Sep 16 01:54:29 2022] DELETE /compute/v2.1/os-volumes/9f87fac7-9c36-4842-98e7-272ffff71ee2 => generated 109 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 01:54:29.985674 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-49822efb-0f92-4a2b-83b2-7e6886fec39c tempest-VolumesNegativeTest-1383864273 tempest-VolumesNegativeTest-1383864273-project] Calling method '.version_select at 0x7fae32efaaf0>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:30.017944 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.wsgi [None req-49822efb-0f92-4a2b-83b2-7e6886fec39c tempest-VolumesNegativeTest-1383864273 tempest-VolumesNegativeTest-1383864273-project] HTTP exception thrown: Volume b3b4d849-4097-4f5e-803d-4dc0331c23b7 could not be found. Sep 16 01:54:30.020517 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-49822efb-0f92-4a2b-83b2-7e6886fec39c tempest-VolumesNegativeTest-1383864273 tempest-VolumesNegativeTest-1383864273-project] Request method failure captured: Sep 16 01:54:30.020517 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: request: GET /compute/v2.1/os-volumes/b3b4d849-4097-4f5e-803d-4dc0331c23b7 HTTP/1.1 Sep 16 01:54:30.020517 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept: application/json Sep 16 01:54:30.020517 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept-Encoding: identity Sep 16 01:54:30.020517 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Connection: close Sep 16 01:54:30.020517 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Length: 0 Sep 16 01:54:30.020517 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Type: application/json Sep 16 01:54:30.020517 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Host: 10.222.0.42 Sep 16 01:54:30.020517 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Openstack-System-Scope: None Sep 16 01:54:30.020517 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: User-Agent: python-urllib3/1.26.12 Sep 16 01:54:30.020517 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Auth-Token: gAAAAABjI9dVUO9dIoGbe8sJlhxVUKNQ2YfHpnTFwL5HNPaSLeVJZPgR66dVkzaZroZXbmw94f1WtI32mOwbFq--Rs4xj3b4ensXKuPlklfwSE1kkxnXfKQeGwcOdjCaBY0cUGDeRqNK-j8rm5-M5fhKKOXZW8JSR3ewmlW6ZhfIDAx5U6QyvkE Sep 16 01:54:30.020517 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Id: None Sep 16 01:54:30.020517 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Name: None Sep 16 01:54:30.020517 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Identity-Status: Confirmed Sep 16 01:54:30.020517 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Is-Admin-Project: True Sep 16 01:54:30.020517 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Id: default Sep 16 01:54:30.020517 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Name: Default Sep 16 01:54:30.020517 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Id: fa5c663186bc4b1d853726a52f70636e Sep 16 01:54:30.020517 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Name: tempest-VolumesNegativeTest-1383864273 Sep 16 01:54:30.020517 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Role: member,reader Sep 16 01:54:30.020517 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Roles: member,reader Sep 16 01:54:30.022313 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/fa5c663186bc4b1d853726a52f70636e"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fa5c663186bc4b1d853726a52f70636e"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_fa5c663186bc4b1d853726a52f70636e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fa5c663186bc4b1d853726a52f70636e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 01:54:30.022313 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant: tempest-VolumesNegativeTest-1383864273 Sep 16 01:54:30.022313 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Id: fa5c663186bc4b1d853726a52f70636e Sep 16 01:54:30.022313 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Name: tempest-VolumesNegativeTest-1383864273 Sep 16 01:54:30.022313 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User: tempest-VolumesNegativeTest-1383864273-project Sep 16 01:54:30.022313 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Id: default Sep 16 01:54:30.022313 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Name: Default Sep 16 01:54:30.022313 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Id: a9620b4f6e0644f9ac7b4a543dc18578 Sep 16 01:54:30.022313 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Name: tempest-VolumesNegativeTest-1383864273-project Sep 16 01:54:30.022313 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: method: Sep 16 01:54:30.022313 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: exception: Volume b3b4d849-4097-4f5e-803d-4dc0331c23b7 could not be found. Sep 16 01:54:30.022313 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: action_args: {'id': 'b3b4d849-4097-4f5e-803d-4dc0331c23b7'} Sep 16 01:54:30.022313 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 01:54:30.022995 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:54:30.022995 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 01:54:30.022995 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 01:54:30.022995 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 16 01:54:30.022995 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 16 01:54:30.022995 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 16 01:54:30.022995 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 16 01:54:30.022995 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 16 01:54:30.022995 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 16 01:54:30.022995 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 16 01:54:30.022995 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 16 01:54:30.022995 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 01:54:30.022995 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 01:54:30.022995 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 01:54:30.022995 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 01:54:30.022995 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume b3b4d849-4097-4f5e-803d-4dc0331c23b7 could not be found. (HTTP 404) (Request-ID: req-c097b1af-955e-4c90-b731-a78897b790d0) Sep 16 01:54:30.022995 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 01:54:30.022995 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:54:30.022995 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 01:54:30.024031 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:54:30.024031 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 16 01:54:30.024031 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 16 01:54:30.024031 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 16 01:54:30.024031 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 16 01:54:30.024031 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 16 01:54:30.024031 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 16 01:54:30.024031 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 16 01:54:30.024031 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 16 01:54:30.024031 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 01:54:30.024031 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 01:54:30.024031 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 16 01:54:30.024031 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 16 01:54:30.024031 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 16 01:54:30.024031 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 16 01:54:30.024031 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 16 01:54:30.024031 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 16 01:54:30.024031 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 16 01:54:30.024031 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 16 01:54:30.025057 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 01:54:30.025057 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 01:54:30.025057 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 01:54:30.025057 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 01:54:30.025057 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume b3b4d849-4097-4f5e-803d-4dc0331c23b7 could not be found. Sep 16 01:54:30.025057 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 01:54:30.025057 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:54:30.025057 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 01:54:30.025057 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:54:30.025057 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 01:54:30.025057 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 01:54:30.025057 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 01:54:30.025057 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 01:54:30.025057 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 01:54:30.025057 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 01:54:30.025057 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 01:54:30.025057 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 01:54:30.025057 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 16 01:54:30.025057 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 01:54:30.026260 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume b3b4d849-4097-4f5e-803d-4dc0331c23b7 could not be found. Sep 16 01:54:30.026260 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 01:54:30.026260 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:54:30.026260 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 01:54:30.026260 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:54:30.026260 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 01:54:30.026260 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 01:54:30.026260 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 01:54:30.026260 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 01:54:30.026260 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume b3b4d849-4097-4f5e-803d-4dc0331c23b7 could not be found. Sep 16 01:54:30.026260 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 01:54:30.027524 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-49822efb-0f92-4a2b-83b2-7e6886fec39c tempest-VolumesNegativeTest-1383864273 tempest-VolumesNegativeTest-1383864273-project] Returning 404 to user: Volume b3b4d849-4097-4f5e-803d-4dc0331c23b7 could not be found. {{(pid=120440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 01:54:30.028439 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-49822efb-0f92-4a2b-83b2-7e6886fec39c tempest-VolumesNegativeTest-1383864273 tempest-VolumesNegativeTest-1383864273-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/b3b4d849-4097-4f5e-803d-4dc0331c23b7" status: 404 len: 109 microversion: 2.1 time: 0.046654 Sep 16 01:54:30.029158 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 51/113] 10.222.0.42 () {58 vars in 1245 bytes} [Fri Sep 16 01:54:29 2022] GET /compute/v2.1/os-volumes/b3b4d849-4097-4f5e-803d-4dc0331c23b7 => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 01:54:30.197097 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-8705671b-5f48-4183-939f-960c7a3c3492 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:30.198365 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-8705671b-5f48-4183-939f-960c7a3c3492 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:30.204720 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8705671b-5f48-4183-939f-960c7a3c3492 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:30.205236 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8705671b-5f48-4183-939f-960c7a3c3492 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:30.205844 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8705671b-5f48-4183-939f-960c7a3c3492 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:30.206550 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8705671b-5f48-4183-939f-960c7a3c3492 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:30.207004 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8705671b-5f48-4183-939f-960c7a3c3492 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:30.207591 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8705671b-5f48-4183-939f-960c7a3c3492 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:30.274159 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-8705671b-5f48-4183-939f-960c7a3c3492 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:30.284468 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-8705671b-5f48-4183-939f-960c7a3c3492 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1273 microversion: 2.1 time: 0.093429 Sep 16 01:54:30.285060 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 63/114] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:30 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1273 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:30.366889 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [req-8169f9ad-2ae8-4111-ac70-c992c624abc1 req-77097447-acb1-4f9d-b3f2-2d0e579ec13d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e390b45-0b39-4429-9431-7ee6af3806e6", "tag": "dc91b77b-583a-4740-a244-adc53daa4347"}]} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:54:30.386989 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-8169f9ad-2ae8-4111-ac70-c992c624abc1 req-77097447-acb1-4f9d-b3f2-2d0e579ec13d service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:30.387478 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-8169f9ad-2ae8-4111-ac70-c992c624abc1 req-77097447-acb1-4f9d-b3f2-2d0e579ec13d service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:30.387916 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-8169f9ad-2ae8-4111-ac70-c992c624abc1 req-77097447-acb1-4f9d-b3f2-2d0e579ec13d service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:30.398654 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-40604ee0-2166-47d4-b4e9-75c6ead01269 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:30.402009 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-40604ee0-2166-47d4-b4e9-75c6ead01269 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:30.409496 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-40604ee0-2166-47d4-b4e9-75c6ead01269 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:30.410085 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-40604ee0-2166-47d4-b4e9-75c6ead01269 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:30.410841 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-40604ee0-2166-47d4-b4e9-75c6ead01269 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:30.411149 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.compute.server_external_events [req-8169f9ad-2ae8-4111-ac70-c992c624abc1 req-77097447-acb1-4f9d-b3f2-2d0e579ec13d service nova] Creating event network-changed:dc91b77b-583a-4740-a244-adc53daa4347 for instance 3e390b45-0b39-4429-9431-7ee6af3806e6 on hv-cinder-84914 Sep 16 01:54:30.411845 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-40604ee0-2166-47d4-b4e9-75c6ead01269 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:30.413287 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-40604ee0-2166-47d4-b4e9-75c6ead01269 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:30.414694 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-40604ee0-2166-47d4-b4e9-75c6ead01269 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:30.420321 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [req-8169f9ad-2ae8-4111-ac70-c992c624abc1 req-77097447-acb1-4f9d-b3f2-2d0e579ec13d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.182654 Sep 16 01:54:30.424434 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 52/115] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 01:54:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 01:54:30.579650 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-40604ee0-2166-47d4-b4e9-75c6ead01269 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:30.591283 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-40604ee0-2166-47d4-b4e9-75c6ead01269 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1364 microversion: 2.1 time: 0.197860 Sep 16 01:54:30.592297 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 64/116] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:30 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1364 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 01:54:30.645942 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-457695f2-ef88-4ba7-b7e6-775b357b126a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:30.647678 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-457695f2-ef88-4ba7-b7e6-775b357b126a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:30.653988 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-457695f2-ef88-4ba7-b7e6-775b357b126a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:30.654477 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-457695f2-ef88-4ba7-b7e6-775b357b126a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:30.655087 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-457695f2-ef88-4ba7-b7e6-775b357b126a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:30.655964 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-457695f2-ef88-4ba7-b7e6-775b357b126a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:30.656552 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-457695f2-ef88-4ba7-b7e6-775b357b126a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:30.657248 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-457695f2-ef88-4ba7-b7e6-775b357b126a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:30.872470 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-457695f2-ef88-4ba7-b7e6-775b357b126a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:30.881200 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-457695f2-ef88-4ba7-b7e6-775b357b126a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:30.882658 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-457695f2-ef88-4ba7-b7e6-775b357b126a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:30.883782 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-457695f2-ef88-4ba7-b7e6-775b357b126a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1408 microversion: 2.20 time: 0.242432 Sep 16 01:54:30.884368 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 53/117] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:54:30 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1408 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:54:30.959560 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-5298f1b3-46dc-4bf1-83f3-df68511371d3 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:30.960315 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-5298f1b3-46dc-4bf1-83f3-df68511371d3 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] [instance: 33b0ab06-b40e-4c13-a33f-cd6a2881fd16] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:30.967185 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5298f1b3-46dc-4bf1-83f3-df68511371d3 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:30.967833 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5298f1b3-46dc-4bf1-83f3-df68511371d3 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:30.968288 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5298f1b3-46dc-4bf1-83f3-df68511371d3 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:30.968980 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5298f1b3-46dc-4bf1-83f3-df68511371d3 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:30.969477 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5298f1b3-46dc-4bf1-83f3-df68511371d3 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:30.969846 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5298f1b3-46dc-4bf1-83f3-df68511371d3 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:31.118866 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-5298f1b3-46dc-4bf1-83f3-df68511371d3 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a39440ed016445a7bfc7ac7fba6661f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477dd0575c8741b0815ddf5f22297db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:31.128247 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-5298f1b3-46dc-4bf1-83f3-df68511371d3 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] 10.222.0.42 "GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16" status: 200 len: 1315 microversion: 2.1 time: 0.173033 Sep 16 01:54:31.141078 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 65/118] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:30 2022] GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:31.307142 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-6e875dcc-32f9-4a04-8247-f0da8eb33f2b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:31.308093 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-6e875dcc-32f9-4a04-8247-f0da8eb33f2b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:31.314031 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6e875dcc-32f9-4a04-8247-f0da8eb33f2b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:31.314592 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6e875dcc-32f9-4a04-8247-f0da8eb33f2b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:31.315089 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6e875dcc-32f9-4a04-8247-f0da8eb33f2b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:31.315833 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6e875dcc-32f9-4a04-8247-f0da8eb33f2b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:31.316490 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6e875dcc-32f9-4a04-8247-f0da8eb33f2b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:31.316916 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6e875dcc-32f9-4a04-8247-f0da8eb33f2b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:31.386932 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-6e875dcc-32f9-4a04-8247-f0da8eb33f2b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:31.394943 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-6e875dcc-32f9-4a04-8247-f0da8eb33f2b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1273 microversion: 2.1 time: 0.092087 Sep 16 01:54:31.395739 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 54/119] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:31 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1273 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:31.616581 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-e7ba150c-1b66-47ee-9da1-bcdce56bd283 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:31.618209 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-e7ba150c-1b66-47ee-9da1-bcdce56bd283 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:31.625132 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e7ba150c-1b66-47ee-9da1-bcdce56bd283 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:31.625476 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e7ba150c-1b66-47ee-9da1-bcdce56bd283 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:31.625933 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e7ba150c-1b66-47ee-9da1-bcdce56bd283 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:31.626615 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e7ba150c-1b66-47ee-9da1-bcdce56bd283 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:31.627126 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e7ba150c-1b66-47ee-9da1-bcdce56bd283 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:31.627622 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e7ba150c-1b66-47ee-9da1-bcdce56bd283 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:31.649500 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell1:SELECT=100 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:31.768634 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-e7ba150c-1b66-47ee-9da1-bcdce56bd283 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:31.776504 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-e7ba150c-1b66-47ee-9da1-bcdce56bd283 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1364 microversion: 2.1 time: 0.166183 Sep 16 01:54:31.777068 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 66/120] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:31 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:31.910909 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-ed4e2c5d-f20f-49ca-9d13-1f06761ce012 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:31.911520 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-ed4e2c5d-f20f-49ca-9d13-1f06761ce012 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:31.918134 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ed4e2c5d-f20f-49ca-9d13-1f06761ce012 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:31.918615 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ed4e2c5d-f20f-49ca-9d13-1f06761ce012 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:31.919045 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ed4e2c5d-f20f-49ca-9d13-1f06761ce012 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:31.919770 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ed4e2c5d-f20f-49ca-9d13-1f06761ce012 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:31.920248 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ed4e2c5d-f20f-49ca-9d13-1f06761ce012 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:31.920667 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ed4e2c5d-f20f-49ca-9d13-1f06761ce012 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:32.055355 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-ed4e2c5d-f20f-49ca-9d13-1f06761ce012 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:32.063393 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-ed4e2c5d-f20f-49ca-9d13-1f06761ce012 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:32.064864 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-ed4e2c5d-f20f-49ca-9d13-1f06761ce012 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:32.065961 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-ed4e2c5d-f20f-49ca-9d13-1f06761ce012 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1408 microversion: 2.20 time: 0.158976 Sep 16 01:54:32.066510 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 55/121] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:54:31 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:54:32.152465 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-d171a59b-292e-4bc2-87f9-5ead930cfbb7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:32.153071 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-d171a59b-292e-4bc2-87f9-5ead930cfbb7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] [instance: 33b0ab06-b40e-4c13-a33f-cd6a2881fd16] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:32.158923 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d171a59b-292e-4bc2-87f9-5ead930cfbb7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:32.159405 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d171a59b-292e-4bc2-87f9-5ead930cfbb7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:32.159845 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d171a59b-292e-4bc2-87f9-5ead930cfbb7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:32.160564 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d171a59b-292e-4bc2-87f9-5ead930cfbb7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:32.161008 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d171a59b-292e-4bc2-87f9-5ead930cfbb7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:32.161498 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d171a59b-292e-4bc2-87f9-5ead930cfbb7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:32.309076 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-d171a59b-292e-4bc2-87f9-5ead930cfbb7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a39440ed016445a7bfc7ac7fba6661f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477dd0575c8741b0815ddf5f22297db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:32.316918 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-d171a59b-292e-4bc2-87f9-5ead930cfbb7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] 10.222.0.42 "GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16" status: 200 len: 1315 microversion: 2.1 time: 0.168264 Sep 16 01:54:32.317477 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 67/122] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:32 2022] GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:32.419052 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-87223885-a158-4e19-ac7a-713cccb0c176 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:32.419782 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-87223885-a158-4e19-ac7a-713cccb0c176 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:32.425609 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-87223885-a158-4e19-ac7a-713cccb0c176 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:32.426176 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-87223885-a158-4e19-ac7a-713cccb0c176 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:32.426494 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-87223885-a158-4e19-ac7a-713cccb0c176 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:32.427168 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-87223885-a158-4e19-ac7a-713cccb0c176 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:32.427901 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-87223885-a158-4e19-ac7a-713cccb0c176 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:32.428382 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-87223885-a158-4e19-ac7a-713cccb0c176 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:32.493552 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-87223885-a158-4e19-ac7a-713cccb0c176 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:32.504658 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-87223885-a158-4e19-ac7a-713cccb0c176 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1273 microversion: 2.1 time: 0.090081 Sep 16 01:54:32.505529 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 56/123] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:32 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1273 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:32.802567 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-de10e7bc-5355-4970-a654-b2d2c01e929a tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:32.804199 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-de10e7bc-5355-4970-a654-b2d2c01e929a tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:32.811476 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-de10e7bc-5355-4970-a654-b2d2c01e929a tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:32.812556 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-de10e7bc-5355-4970-a654-b2d2c01e929a tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:32.813167 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-de10e7bc-5355-4970-a654-b2d2c01e929a tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:32.813915 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-de10e7bc-5355-4970-a654-b2d2c01e929a tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:32.814359 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-de10e7bc-5355-4970-a654-b2d2c01e929a tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:32.814782 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-de10e7bc-5355-4970-a654-b2d2c01e929a tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:32.993651 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-de10e7bc-5355-4970-a654-b2d2c01e929a tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:33.007013 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-de10e7bc-5355-4970-a654-b2d2c01e929a tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1364 microversion: 2.1 time: 0.209525 Sep 16 01:54:33.009718 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 68/124] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:32 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1364 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:33.094919 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-b72bfb7f-bcf3-4d2d-8940-99721af02574 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:33.095598 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-b72bfb7f-bcf3-4d2d-8940-99721af02574 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:33.103728 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b72bfb7f-bcf3-4d2d-8940-99721af02574 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:33.104259 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b72bfb7f-bcf3-4d2d-8940-99721af02574 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:33.104727 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b72bfb7f-bcf3-4d2d-8940-99721af02574 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:33.105429 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b72bfb7f-bcf3-4d2d-8940-99721af02574 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:33.106086 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b72bfb7f-bcf3-4d2d-8940-99721af02574 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:33.106520 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b72bfb7f-bcf3-4d2d-8940-99721af02574 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:33.309229 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-b72bfb7f-bcf3-4d2d-8940-99721af02574 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:33.324748 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-b72bfb7f-bcf3-4d2d-8940-99721af02574 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:33.326215 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-b72bfb7f-bcf3-4d2d-8940-99721af02574 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:33.327328 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-b72bfb7f-bcf3-4d2d-8940-99721af02574 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1408 microversion: 2.20 time: 0.239203 Sep 16 01:54:33.336374 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 57/125] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:54:33 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1408 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:54:33.344788 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-2ad48bd9-ea99-4ccd-9573-2d3829b2fd4a tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:33.347073 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-2ad48bd9-ea99-4ccd-9573-2d3829b2fd4a tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] [instance: 33b0ab06-b40e-4c13-a33f-cd6a2881fd16] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:33.359255 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2ad48bd9-ea99-4ccd-9573-2d3829b2fd4a tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:33.360159 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2ad48bd9-ea99-4ccd-9573-2d3829b2fd4a tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:33.360924 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2ad48bd9-ea99-4ccd-9573-2d3829b2fd4a tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:33.361984 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2ad48bd9-ea99-4ccd-9573-2d3829b2fd4a tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:33.362447 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2ad48bd9-ea99-4ccd-9573-2d3829b2fd4a tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:33.362874 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2ad48bd9-ea99-4ccd-9573-2d3829b2fd4a tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:33.527835 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-75ca3cf8-346c-401b-a8f1-a4f6912761ea tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:33.528476 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-75ca3cf8-346c-401b-a8f1-a4f6912761ea tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:33.536264 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-75ca3cf8-346c-401b-a8f1-a4f6912761ea tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:33.537619 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-75ca3cf8-346c-401b-a8f1-a4f6912761ea tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:33.538658 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-75ca3cf8-346c-401b-a8f1-a4f6912761ea tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:33.542382 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-75ca3cf8-346c-401b-a8f1-a4f6912761ea tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:33.542966 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-75ca3cf8-346c-401b-a8f1-a4f6912761ea tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:33.543578 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-75ca3cf8-346c-401b-a8f1-a4f6912761ea tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:33.550791 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell1:SELECT=100 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:33.646431 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-75ca3cf8-346c-401b-a8f1-a4f6912761ea tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:33.654207 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-75ca3cf8-346c-401b-a8f1-a4f6912761ea tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1273 microversion: 2.1 time: 0.130048 Sep 16 01:54:33.654784 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 58/126] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:33 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1273 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:33.786320 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-2ad48bd9-ea99-4ccd-9573-2d3829b2fd4a tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a39440ed016445a7bfc7ac7fba6661f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477dd0575c8741b0815ddf5f22297db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:33.800357 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-2ad48bd9-ea99-4ccd-9573-2d3829b2fd4a tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] 10.222.0.42 "GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16" status: 200 len: 1315 microversion: 2.1 time: 0.464804 Sep 16 01:54:33.801988 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 69/127] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:33 2022] GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16 => generated 1315 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:34.051754 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-45242f63-525e-4dd9-a395-e6cf51b49d2d tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:34.054019 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-45242f63-525e-4dd9-a395-e6cf51b49d2d tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:34.074309 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-45242f63-525e-4dd9-a395-e6cf51b49d2d tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:34.075094 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-45242f63-525e-4dd9-a395-e6cf51b49d2d tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:34.076807 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-45242f63-525e-4dd9-a395-e6cf51b49d2d tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:34.077969 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-45242f63-525e-4dd9-a395-e6cf51b49d2d tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:34.079240 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-45242f63-525e-4dd9-a395-e6cf51b49d2d tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:34.081077 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-45242f63-525e-4dd9-a395-e6cf51b49d2d tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:34.357508 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-787570c2-f23f-4cee-a501-0126a6489b5d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:34.360817 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-787570c2-f23f-4cee-a501-0126a6489b5d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:34.387620 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-787570c2-f23f-4cee-a501-0126a6489b5d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:34.388610 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-787570c2-f23f-4cee-a501-0126a6489b5d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:34.390204 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-787570c2-f23f-4cee-a501-0126a6489b5d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:34.392142 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-787570c2-f23f-4cee-a501-0126a6489b5d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:34.393716 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-45242f63-525e-4dd9-a395-e6cf51b49d2d tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:34.397676 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-787570c2-f23f-4cee-a501-0126a6489b5d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:34.400357 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-787570c2-f23f-4cee-a501-0126a6489b5d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:34.409335 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-45242f63-525e-4dd9-a395-e6cf51b49d2d tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1364 microversion: 2.1 time: 0.381256 Sep 16 01:54:34.409925 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 59/128] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:34 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1364 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 01:54:34.681865 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-0be6cbbe-9344-4c99-80b6-c1b17fa6522a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:34.682641 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-0be6cbbe-9344-4c99-80b6-c1b17fa6522a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:34.689171 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0be6cbbe-9344-4c99-80b6-c1b17fa6522a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:34.689971 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0be6cbbe-9344-4c99-80b6-c1b17fa6522a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:34.690548 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0be6cbbe-9344-4c99-80b6-c1b17fa6522a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:34.691596 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0be6cbbe-9344-4c99-80b6-c1b17fa6522a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:34.692142 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0be6cbbe-9344-4c99-80b6-c1b17fa6522a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:34.692567 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0be6cbbe-9344-4c99-80b6-c1b17fa6522a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:34.820463 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-0be6cbbe-9344-4c99-80b6-c1b17fa6522a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:34.835816 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-0be6cbbe-9344-4c99-80b6-c1b17fa6522a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1279 microversion: 2.1 time: 0.158100 Sep 16 01:54:34.836706 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 60/129] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:34 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1279 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 01:54:34.841700 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-a9a492be-548a-4fdf-9d73-a108f2df7ae1 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:34.842524 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-a9a492be-548a-4fdf-9d73-a108f2df7ae1 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] [instance: 33b0ab06-b40e-4c13-a33f-cd6a2881fd16] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:34.849451 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a9a492be-548a-4fdf-9d73-a108f2df7ae1 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:34.850680 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a9a492be-548a-4fdf-9d73-a108f2df7ae1 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:34.851487 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a9a492be-548a-4fdf-9d73-a108f2df7ae1 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:34.852461 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a9a492be-548a-4fdf-9d73-a108f2df7ae1 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:34.853594 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a9a492be-548a-4fdf-9d73-a108f2df7ae1 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:34.854215 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a9a492be-548a-4fdf-9d73-a108f2df7ae1 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:34.926451 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-787570c2-f23f-4cee-a501-0126a6489b5d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:34.945746 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-787570c2-f23f-4cee-a501-0126a6489b5d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:34.950638 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-787570c2-f23f-4cee-a501-0126a6489b5d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:34.953195 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-787570c2-f23f-4cee-a501-0126a6489b5d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1408 microversion: 2.20 time: 0.600514 Sep 16 01:54:34.956637 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 70/130] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:54:34 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1408 bytes in 607 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 01:54:35.225164 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-a9a492be-548a-4fdf-9d73-a108f2df7ae1 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a39440ed016445a7bfc7ac7fba6661f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477dd0575c8741b0815ddf5f22297db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:35.235575 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-a9a492be-548a-4fdf-9d73-a108f2df7ae1 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] 10.222.0.42 "GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16" status: 200 len: 1315 microversion: 2.1 time: 0.397560 Sep 16 01:54:35.253304 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 61/131] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:34 2022] GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16 => generated 1315 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:35.439805 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-242e4d58-99fc-4221-90e5-6fabe3ac56c6 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:35.440630 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-242e4d58-99fc-4221-90e5-6fabe3ac56c6 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:35.451385 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-242e4d58-99fc-4221-90e5-6fabe3ac56c6 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:35.451880 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-242e4d58-99fc-4221-90e5-6fabe3ac56c6 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:35.453488 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-242e4d58-99fc-4221-90e5-6fabe3ac56c6 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:35.456497 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-242e4d58-99fc-4221-90e5-6fabe3ac56c6 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:35.457546 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-242e4d58-99fc-4221-90e5-6fabe3ac56c6 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:35.459795 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-242e4d58-99fc-4221-90e5-6fabe3ac56c6 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:35.866258 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-cb512634-95ea-435c-80ad-8c495efeb991 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:35.866802 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-cb512634-95ea-435c-80ad-8c495efeb991 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:35.880274 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cb512634-95ea-435c-80ad-8c495efeb991 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:35.881257 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cb512634-95ea-435c-80ad-8c495efeb991 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:35.881899 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cb512634-95ea-435c-80ad-8c495efeb991 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:35.882820 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cb512634-95ea-435c-80ad-8c495efeb991 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:35.883487 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cb512634-95ea-435c-80ad-8c495efeb991 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:35.886464 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cb512634-95ea-435c-80ad-8c495efeb991 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:36.191297 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-242e4d58-99fc-4221-90e5-6fabe3ac56c6 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:36.203544 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-242e4d58-99fc-4221-90e5-6fabe3ac56c6 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1364 microversion: 2.1 time: 0.768698 Sep 16 01:54:36.220312 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 71/132] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:35 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1364 bytes in 786 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:36.226000 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [req-f24e11dd-932c-4212-988a-2a41c08227ce req-5a6ab313-b08c-4d5a-b841-41c9f384a75d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48c9b577-5e65-464f-9328-da6dc694277c", "tag": "6bf23a1f-07f6-4b96-abf5-7191389578be"}]} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:54:36.241344 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-f24e11dd-932c-4212-988a-2a41c08227ce req-5a6ab313-b08c-4d5a-b841-41c9f384a75d service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:36.242067 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-f24e11dd-932c-4212-988a-2a41c08227ce req-5a6ab313-b08c-4d5a-b841-41c9f384a75d service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:36.242676 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-f24e11dd-932c-4212-988a-2a41c08227ce req-5a6ab313-b08c-4d5a-b841-41c9f384a75d service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:36.265718 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.compute.server_external_events [req-f24e11dd-932c-4212-988a-2a41c08227ce req-5a6ab313-b08c-4d5a-b841-41c9f384a75d service nova] Creating event network-changed:6bf23a1f-07f6-4b96-abf5-7191389578be for instance 48c9b577-5e65-464f-9328-da6dc694277c on hv-cinder-84914 Sep 16 01:54:36.266532 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-f24e11dd-932c-4212-988a-2a41c08227ce req-5a6ab313-b08c-4d5a-b841-41c9f384a75d service nova] Acquiring lock "compute-rpcapi-router" {{(pid=120441) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 16 01:54:36.267100 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-f24e11dd-932c-4212-988a-2a41c08227ce req-5a6ab313-b08c-4d5a-b841-41c9f384a75d service nova] Acquired lock "compute-rpcapi-router" {{(pid=120441) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 16 01:54:36.268514 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7f3a1ceb-b589-4da8-9c6c-2d66845a3eca None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:36.269156 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7f3a1ceb-b589-4da8-9c6c-2d66845a3eca None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:36.269796 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7f3a1ceb-b589-4da8-9c6c-2d66845a3eca None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:36.270717 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7f3a1ceb-b589-4da8-9c6c-2d66845a3eca None None] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:36.271912 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7f3a1ceb-b589-4da8-9c6c-2d66845a3eca None None] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:36.272560 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7f3a1ceb-b589-4da8-9c6c-2d66845a3eca None None] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:36.283383 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.compute.rpcapi [None req-7f3a1ceb-b589-4da8-9c6c-2d66845a3eca None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 16 01:54:36.284677 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7f3a1ceb-b589-4da8-9c6c-2d66845a3eca None None] Releasing lock "compute-rpcapi-router" {{(pid=120441) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 16 01:54:36.300484 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-7f3a1ceb-b589-4da8-9c6c-2d66845a3eca None None] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.078935 Sep 16 01:54:36.301856 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 72/133] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 01:54:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:54:36.310158 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-2de277aa-782f-420b-8562-1cc3848d6eb2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:36.311075 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-2de277aa-782f-420b-8562-1cc3848d6eb2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:36.319351 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2de277aa-782f-420b-8562-1cc3848d6eb2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:36.320206 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2de277aa-782f-420b-8562-1cc3848d6eb2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:36.320849 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2de277aa-782f-420b-8562-1cc3848d6eb2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:36.321782 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2de277aa-782f-420b-8562-1cc3848d6eb2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:36.322536 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2de277aa-782f-420b-8562-1cc3848d6eb2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:36.323192 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2de277aa-782f-420b-8562-1cc3848d6eb2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:36.446633 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-cb512634-95ea-435c-80ad-8c495efeb991 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:36.455757 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-cb512634-95ea-435c-80ad-8c495efeb991 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1321 microversion: 2.1 time: 0.594045 Sep 16 01:54:36.456440 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 62/134] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:35 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1321 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 01:54:36.472412 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-72f982d7-f947-4271-8a9c-a13eb02b7cd0 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:36.472412 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-72f982d7-f947-4271-8a9c-a13eb02b7cd0 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] [instance: 33b0ab06-b40e-4c13-a33f-cd6a2881fd16] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:36.474107 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-72f982d7-f947-4271-8a9c-a13eb02b7cd0 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:36.474805 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-72f982d7-f947-4271-8a9c-a13eb02b7cd0 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:36.475263 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-72f982d7-f947-4271-8a9c-a13eb02b7cd0 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:36.476707 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-72f982d7-f947-4271-8a9c-a13eb02b7cd0 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:36.476707 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-72f982d7-f947-4271-8a9c-a13eb02b7cd0 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:36.477062 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-72f982d7-f947-4271-8a9c-a13eb02b7cd0 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:36.757840 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-72f982d7-f947-4271-8a9c-a13eb02b7cd0 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a39440ed016445a7bfc7ac7fba6661f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477dd0575c8741b0815ddf5f22297db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:36.772144 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-72f982d7-f947-4271-8a9c-a13eb02b7cd0 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] 10.222.0.42 "GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16" status: 200 len: 1315 microversion: 2.1 time: 0.308040 Sep 16 01:54:36.773421 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 63/135] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:36 2022] GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16 => generated 1315 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:36.848975 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-2de277aa-782f-420b-8562-1cc3848d6eb2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:36.866930 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-2de277aa-782f-420b-8562-1cc3848d6eb2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:36.877969 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-2de277aa-782f-420b-8562-1cc3848d6eb2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:36.883148 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-2de277aa-782f-420b-8562-1cc3848d6eb2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1408 microversion: 2.20 time: 0.578429 Sep 16 01:54:36.887268 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 73/136] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:54:36 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1408 bytes in 584 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:54:37.235292 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-250ac4ed-e786-4c62-9bd4-64be10c8ffb0 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:37.236498 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-250ac4ed-e786-4c62-9bd4-64be10c8ffb0 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:37.247724 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-250ac4ed-e786-4c62-9bd4-64be10c8ffb0 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:37.248560 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-250ac4ed-e786-4c62-9bd4-64be10c8ffb0 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:37.248980 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-250ac4ed-e786-4c62-9bd4-64be10c8ffb0 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:37.251752 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-250ac4ed-e786-4c62-9bd4-64be10c8ffb0 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:37.252230 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-250ac4ed-e786-4c62-9bd4-64be10c8ffb0 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:37.252659 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-250ac4ed-e786-4c62-9bd4-64be10c8ffb0 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:37.441467 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [req-a8474c24-5e5e-4d68-8406-188c229e5acc req-9cda7c7f-108a-4f25-81b9-a8cde71e0e1b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7", "tag": "f93c0228-6dda-49f9-ac21-d2d3362262fa"}]} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:54:37.460783 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-a8474c24-5e5e-4d68-8406-188c229e5acc req-9cda7c7f-108a-4f25-81b9-a8cde71e0e1b service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:37.461268 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-a8474c24-5e5e-4d68-8406-188c229e5acc req-9cda7c7f-108a-4f25-81b9-a8cde71e0e1b service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:37.461693 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-a8474c24-5e5e-4d68-8406-188c229e5acc req-9cda7c7f-108a-4f25-81b9-a8cde71e0e1b service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:37.502840 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.compute.server_external_events [req-a8474c24-5e5e-4d68-8406-188c229e5acc req-9cda7c7f-108a-4f25-81b9-a8cde71e0e1b service nova] Creating event network-changed:f93c0228-6dda-49f9-ac21-d2d3362262fa for instance 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 on hv-cinder-84914 Sep 16 01:54:37.517952 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [req-a8474c24-5e5e-4d68-8406-188c229e5acc req-9cda7c7f-108a-4f25-81b9-a8cde71e0e1b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.080618 Sep 16 01:54:37.518927 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 74/137] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 01:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 01:54:37.526614 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-ccea27b1-01c4-47a3-a976-c038c04eb459 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:37.527406 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-ccea27b1-01c4-47a3-a976-c038c04eb459 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:37.540046 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ccea27b1-01c4-47a3-a976-c038c04eb459 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:37.540542 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ccea27b1-01c4-47a3-a976-c038c04eb459 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:37.540975 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ccea27b1-01c4-47a3-a976-c038c04eb459 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:37.545977 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ccea27b1-01c4-47a3-a976-c038c04eb459 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:37.546600 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ccea27b1-01c4-47a3-a976-c038c04eb459 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:37.549885 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ccea27b1-01c4-47a3-a976-c038c04eb459 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:37.674909 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-250ac4ed-e786-4c62-9bd4-64be10c8ffb0 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:37.683618 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-250ac4ed-e786-4c62-9bd4-64be10c8ffb0 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1364 microversion: 2.1 time: 0.454003 Sep 16 01:54:37.686364 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 64/138] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:37 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1364 bytes in 457 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:37.921139 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-ccea27b1-01c4-47a3-a976-c038c04eb459 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:37.934926 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-ccea27b1-01c4-47a3-a976-c038c04eb459 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1321 microversion: 2.1 time: 0.414642 Sep 16 01:54:37.937598 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 75/139] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:37 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1321 bytes in 418 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:37.957516 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-82e7258d-6867-4a2a-92ff-0cb4def24f88 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:37.958370 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-82e7258d-6867-4a2a-92ff-0cb4def24f88 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] [instance: 33b0ab06-b40e-4c13-a33f-cd6a2881fd16] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:37.967866 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-82e7258d-6867-4a2a-92ff-0cb4def24f88 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:37.973056 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [req-8f634a05-888c-4ad7-a703-a97ecd04472d req-c6f958dc-9525-486a-979c-7c710c1641e3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33b0ab06-b40e-4c13-a33f-cd6a2881fd16", "name": "network-vif-plugged", "status": "completed", "tag": "fa997e48-0418-472d-a98e-8a93319ff371"}]} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:54:37.975524 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-82e7258d-6867-4a2a-92ff-0cb4def24f88 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:37.975960 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-82e7258d-6867-4a2a-92ff-0cb4def24f88 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:37.976727 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-82e7258d-6867-4a2a-92ff-0cb4def24f88 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:37.977193 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-82e7258d-6867-4a2a-92ff-0cb4def24f88 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:37.978199 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-82e7258d-6867-4a2a-92ff-0cb4def24f88 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:37.999221 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-8f634a05-888c-4ad7-a703-a97ecd04472d req-c6f958dc-9525-486a-979c-7c710c1641e3 service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:38.000543 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-8f634a05-888c-4ad7-a703-a97ecd04472d req-c6f958dc-9525-486a-979c-7c710c1641e3 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:38.001433 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-8f634a05-888c-4ad7-a703-a97ecd04472d req-c6f958dc-9525-486a-979c-7c710c1641e3 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:38.019342 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.compute.server_external_events [req-8f634a05-888c-4ad7-a703-a97ecd04472d req-c6f958dc-9525-486a-979c-7c710c1641e3 service nova] Creating event network-vif-plugged:fa997e48-0418-472d-a98e-8a93319ff371 for instance 33b0ab06-b40e-4c13-a33f-cd6a2881fd16 on hv-cinder-84914 Sep 16 01:54:38.032626 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [req-8f634a05-888c-4ad7-a703-a97ecd04472d req-c6f958dc-9525-486a-979c-7c710c1641e3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.309682 Sep 16 01:54:38.035905 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 65/140] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 01:54:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 01:54:38.044888 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-7d500120-ce6c-4177-af96-1a43fdb08d36 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:38.046212 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-7d500120-ce6c-4177-af96-1a43fdb08d36 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:38.056818 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7d500120-ce6c-4177-af96-1a43fdb08d36 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:38.058556 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7d500120-ce6c-4177-af96-1a43fdb08d36 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:38.059151 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7d500120-ce6c-4177-af96-1a43fdb08d36 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:38.060048 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7d500120-ce6c-4177-af96-1a43fdb08d36 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:38.060683 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7d500120-ce6c-4177-af96-1a43fdb08d36 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:38.061247 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7d500120-ce6c-4177-af96-1a43fdb08d36 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:38.193956 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-82e7258d-6867-4a2a-92ff-0cb4def24f88 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a39440ed016445a7bfc7ac7fba6661f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477dd0575c8741b0815ddf5f22297db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:38.202084 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-82e7258d-6867-4a2a-92ff-0cb4def24f88 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] 10.222.0.42 "GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16" status: 200 len: 1315 microversion: 2.1 time: 0.262640 Sep 16 01:54:38.202644 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 76/141] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:37 2022] GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16 => generated 1315 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:38.345711 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-7d500120-ce6c-4177-af96-1a43fdb08d36 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:38.377875 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-7d500120-ce6c-4177-af96-1a43fdb08d36 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:38.385165 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-7d500120-ce6c-4177-af96-1a43fdb08d36 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:38.389566 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-7d500120-ce6c-4177-af96-1a43fdb08d36 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1408 microversion: 2.20 time: 0.350995 Sep 16 01:54:38.413824 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 66/142] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:54:38 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1408 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:54:38.571362 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [req-d1cc049b-22c0-437d-b120-2a2ec5523716 req-3bf113f8-44b1-445d-86cd-92ba725059f8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df8bdee8-15d2-4b18-a2d0-8b24b43f6763", "tag": "32e8d554-2d45-428d-8c7c-03347e83c61a"}]} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:54:38.585169 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-d1cc049b-22c0-437d-b120-2a2ec5523716 req-3bf113f8-44b1-445d-86cd-92ba725059f8 service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:38.586546 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-d1cc049b-22c0-437d-b120-2a2ec5523716 req-3bf113f8-44b1-445d-86cd-92ba725059f8 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:38.587447 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-d1cc049b-22c0-437d-b120-2a2ec5523716 req-3bf113f8-44b1-445d-86cd-92ba725059f8 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:38.603288 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.compute.server_external_events [req-d1cc049b-22c0-437d-b120-2a2ec5523716 req-3bf113f8-44b1-445d-86cd-92ba725059f8 service nova] Creating event network-changed:32e8d554-2d45-428d-8c7c-03347e83c61a for instance df8bdee8-15d2-4b18-a2d0-8b24b43f6763 on hv-cinder-84914 Sep 16 01:54:38.610356 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [req-d1cc049b-22c0-437d-b120-2a2ec5523716 req-3bf113f8-44b1-445d-86cd-92ba725059f8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044150 Sep 16 01:54:38.611833 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 77/143] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 01:54:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:54:38.715825 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-b079c5f0-f0f9-430f-b3da-8b627ff8b413 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:38.716659 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-b079c5f0-f0f9-430f-b3da-8b627ff8b413 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:38.725484 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b079c5f0-f0f9-430f-b3da-8b627ff8b413 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:38.726141 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b079c5f0-f0f9-430f-b3da-8b627ff8b413 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:38.726737 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b079c5f0-f0f9-430f-b3da-8b627ff8b413 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:38.727618 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b079c5f0-f0f9-430f-b3da-8b627ff8b413 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:38.728115 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b079c5f0-f0f9-430f-b3da-8b627ff8b413 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:38.728684 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b079c5f0-f0f9-430f-b3da-8b627ff8b413 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:38.946202 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-b079c5f0-f0f9-430f-b3da-8b627ff8b413 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:38.955263 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-b079c5f0-f0f9-430f-b3da-8b627ff8b413 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1364 microversion: 2.1 time: 0.252343 Sep 16 01:54:38.956121 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 67/144] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:38 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1364 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:38.963973 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-046f35dc-b4b4-4763-ab2f-dd60324d28b3 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:38.965198 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-046f35dc-b4b4-4763-ab2f-dd60324d28b3 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:38.976322 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-046f35dc-b4b4-4763-ab2f-dd60324d28b3 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:38.977080 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-046f35dc-b4b4-4763-ab2f-dd60324d28b3 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:38.977515 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-046f35dc-b4b4-4763-ab2f-dd60324d28b3 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:38.978544 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-046f35dc-b4b4-4763-ab2f-dd60324d28b3 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:38.979011 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-046f35dc-b4b4-4763-ab2f-dd60324d28b3 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:38.979433 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-046f35dc-b4b4-4763-ab2f-dd60324d28b3 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:39.228118 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-9ba33e6e-f87b-43c5-a1d1-d3c7c3bbefe7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:39.229043 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-9ba33e6e-f87b-43c5-a1d1-d3c7c3bbefe7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] [instance: 33b0ab06-b40e-4c13-a33f-cd6a2881fd16] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:39.240820 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9ba33e6e-f87b-43c5-a1d1-d3c7c3bbefe7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:39.241584 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9ba33e6e-f87b-43c5-a1d1-d3c7c3bbefe7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:39.245344 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9ba33e6e-f87b-43c5-a1d1-d3c7c3bbefe7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:39.246542 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9ba33e6e-f87b-43c5-a1d1-d3c7c3bbefe7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:39.249173 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9ba33e6e-f87b-43c5-a1d1-d3c7c3bbefe7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:39.249943 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9ba33e6e-f87b-43c5-a1d1-d3c7c3bbefe7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:39.433734 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-046f35dc-b4b4-4763-ab2f-dd60324d28b3 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:39.448673 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-046f35dc-b4b4-4763-ab2f-dd60324d28b3 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1321 microversion: 2.1 time: 0.490565 Sep 16 01:54:39.461844 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 78/145] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:38 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1321 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:39.461844 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-74ee8043-6cfe-48af-ac43-45164da68b98 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:39.461844 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-74ee8043-6cfe-48af-ac43-45164da68b98 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:39.470948 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-74ee8043-6cfe-48af-ac43-45164da68b98 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:39.473588 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-74ee8043-6cfe-48af-ac43-45164da68b98 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:39.475206 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-74ee8043-6cfe-48af-ac43-45164da68b98 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:39.476651 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-74ee8043-6cfe-48af-ac43-45164da68b98 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:39.477665 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-74ee8043-6cfe-48af-ac43-45164da68b98 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:39.478448 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-74ee8043-6cfe-48af-ac43-45164da68b98 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:39.665104 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-9ba33e6e-f87b-43c5-a1d1-d3c7c3bbefe7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a39440ed016445a7bfc7ac7fba6661f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477dd0575c8741b0815ddf5f22297db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:39.676196 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-9ba33e6e-f87b-43c5-a1d1-d3c7c3bbefe7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] 10.222.0.42 "GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16" status: 200 len: 1315 microversion: 2.1 time: 0.454641 Sep 16 01:54:39.678903 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 68/146] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:39 2022] GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16 => generated 1315 bytes in 458 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 01:54:39.960653 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-74ee8043-6cfe-48af-ac43-45164da68b98 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:39.973973 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-74ee8043-6cfe-48af-ac43-45164da68b98 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:39.979441 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-74ee8043-6cfe-48af-ac43-45164da68b98 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:39.983649 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-37445866-3283-4171-92e4-67a2604fc49a tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:39.984428 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-37445866-3283-4171-92e4-67a2604fc49a tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:39.984718 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-74ee8043-6cfe-48af-ac43-45164da68b98 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1408 microversion: 2.20 time: 0.530373 Sep 16 01:54:39.987465 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 79/147] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:54:39 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1408 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:54:39.995768 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-37445866-3283-4171-92e4-67a2604fc49a tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:40.000111 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-37445866-3283-4171-92e4-67a2604fc49a tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:40.001029 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-37445866-3283-4171-92e4-67a2604fc49a tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:40.002115 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-37445866-3283-4171-92e4-67a2604fc49a tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:40.017694 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-37445866-3283-4171-92e4-67a2604fc49a tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:40.018628 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-37445866-3283-4171-92e4-67a2604fc49a tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:40.239507 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-37445866-3283-4171-92e4-67a2604fc49a tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:40.247803 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-37445866-3283-4171-92e4-67a2604fc49a tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1364 microversion: 2.1 time: 0.269519 Sep 16 01:54:40.248422 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 69/148] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:39 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1364 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:40.479092 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-a67b95bd-0cae-432e-85ee-53149283f603 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:40.479092 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-a67b95bd-0cae-432e-85ee-53149283f603 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:40.485870 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a67b95bd-0cae-432e-85ee-53149283f603 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:40.486375 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a67b95bd-0cae-432e-85ee-53149283f603 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:40.486851 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a67b95bd-0cae-432e-85ee-53149283f603 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:40.487663 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a67b95bd-0cae-432e-85ee-53149283f603 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:40.488515 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a67b95bd-0cae-432e-85ee-53149283f603 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:40.488934 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a67b95bd-0cae-432e-85ee-53149283f603 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:40.641684 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-a67b95bd-0cae-432e-85ee-53149283f603 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:40.649450 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-a67b95bd-0cae-432e-85ee-53149283f603 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1321 microversion: 2.1 time: 0.176538 Sep 16 01:54:40.650214 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 80/149] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:40 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1321 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:40.706204 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-45695cae-7744-48cc-b822-aca363cf04ce tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:40.706839 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-45695cae-7744-48cc-b822-aca363cf04ce tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] [instance: 33b0ab06-b40e-4c13-a33f-cd6a2881fd16] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:40.713667 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-45695cae-7744-48cc-b822-aca363cf04ce tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:40.714147 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-45695cae-7744-48cc-b822-aca363cf04ce tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:40.714573 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-45695cae-7744-48cc-b822-aca363cf04ce tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:40.715256 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-45695cae-7744-48cc-b822-aca363cf04ce tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:40.715698 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-45695cae-7744-48cc-b822-aca363cf04ce tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:40.716606 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-45695cae-7744-48cc-b822-aca363cf04ce tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:40.877876 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-45695cae-7744-48cc-b822-aca363cf04ce tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a39440ed016445a7bfc7ac7fba6661f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477dd0575c8741b0815ddf5f22297db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:40.886767 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-45695cae-7744-48cc-b822-aca363cf04ce tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] 10.222.0.42 "GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16" status: 200 len: 1315 microversion: 2.1 time: 0.184396 Sep 16 01:54:40.887334 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 70/150] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:40 2022] GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:41.022671 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-545c78b1-fbaf-4a20-b36f-4a686f9af5e1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:41.025172 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-545c78b1-fbaf-4a20-b36f-4a686f9af5e1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:41.034560 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-545c78b1-fbaf-4a20-b36f-4a686f9af5e1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:41.035121 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-545c78b1-fbaf-4a20-b36f-4a686f9af5e1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:41.035630 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-545c78b1-fbaf-4a20-b36f-4a686f9af5e1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:41.036955 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-545c78b1-fbaf-4a20-b36f-4a686f9af5e1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:41.037577 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-545c78b1-fbaf-4a20-b36f-4a686f9af5e1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:41.038000 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-545c78b1-fbaf-4a20-b36f-4a686f9af5e1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:41.183706 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-545c78b1-fbaf-4a20-b36f-4a686f9af5e1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:41.195927 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-545c78b1-fbaf-4a20-b36f-4a686f9af5e1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:41.198564 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-545c78b1-fbaf-4a20-b36f-4a686f9af5e1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:41.199838 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-545c78b1-fbaf-4a20-b36f-4a686f9af5e1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1408 microversion: 2.20 time: 0.186585 Sep 16 01:54:41.211963 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 81/151] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:54:41 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1408 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:54:41.274288 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-57526553-5a52-42f2-96b9-bff7956bc576 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:41.274982 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-57526553-5a52-42f2-96b9-bff7956bc576 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:41.281319 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-57526553-5a52-42f2-96b9-bff7956bc576 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:41.281948 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-57526553-5a52-42f2-96b9-bff7956bc576 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:41.282633 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-57526553-5a52-42f2-96b9-bff7956bc576 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:41.283536 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-57526553-5a52-42f2-96b9-bff7956bc576 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:41.284163 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-57526553-5a52-42f2-96b9-bff7956bc576 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:41.284862 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-57526553-5a52-42f2-96b9-bff7956bc576 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:41.431205 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-57526553-5a52-42f2-96b9-bff7956bc576 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:41.440711 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-57526553-5a52-42f2-96b9-bff7956bc576 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1364 microversion: 2.1 time: 0.171363 Sep 16 01:54:41.441541 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 71/152] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:41 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:41.673281 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-b6e7810d-3961-4775-9f69-eb64358a2803 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:41.673927 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-b6e7810d-3961-4775-9f69-eb64358a2803 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:41.680899 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b6e7810d-3961-4775-9f69-eb64358a2803 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:41.681635 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b6e7810d-3961-4775-9f69-eb64358a2803 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:41.682292 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b6e7810d-3961-4775-9f69-eb64358a2803 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:41.683169 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b6e7810d-3961-4775-9f69-eb64358a2803 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:41.683798 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b6e7810d-3961-4775-9f69-eb64358a2803 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:41.684394 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b6e7810d-3961-4775-9f69-eb64358a2803 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:41.838610 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-b6e7810d-3961-4775-9f69-eb64358a2803 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:41.847860 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-b6e7810d-3961-4775-9f69-eb64358a2803 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1321 microversion: 2.1 time: 0.178518 Sep 16 01:54:41.850478 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 82/153] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:41 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1321 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:41.909810 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-d9d5ea83-01bb-41c6-87fa-3637c5a2eed7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:41.910470 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-d9d5ea83-01bb-41c6-87fa-3637c5a2eed7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] [instance: 33b0ab06-b40e-4c13-a33f-cd6a2881fd16] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:41.916622 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d9d5ea83-01bb-41c6-87fa-3637c5a2eed7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:41.917101 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d9d5ea83-01bb-41c6-87fa-3637c5a2eed7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:41.917690 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d9d5ea83-01bb-41c6-87fa-3637c5a2eed7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:41.918523 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d9d5ea83-01bb-41c6-87fa-3637c5a2eed7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:41.919226 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d9d5ea83-01bb-41c6-87fa-3637c5a2eed7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:41.919881 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d9d5ea83-01bb-41c6-87fa-3637c5a2eed7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:42.108381 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-d9d5ea83-01bb-41c6-87fa-3637c5a2eed7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a39440ed016445a7bfc7ac7fba6661f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477dd0575c8741b0815ddf5f22297db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:42.117208 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-d9d5ea83-01bb-41c6-87fa-3637c5a2eed7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] 10.222.0.42 "GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16" status: 200 len: 1315 microversion: 2.1 time: 0.211465 Sep 16 01:54:42.117971 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 72/154] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:41 2022] GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16 => generated 1315 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:42.233495 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-2d073a11-0636-40e9-9df6-9e8414a16709 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:42.234391 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-2d073a11-0636-40e9-9df6-9e8414a16709 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:42.241140 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2d073a11-0636-40e9-9df6-9e8414a16709 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:42.242010 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2d073a11-0636-40e9-9df6-9e8414a16709 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:42.242518 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2d073a11-0636-40e9-9df6-9e8414a16709 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:42.243266 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2d073a11-0636-40e9-9df6-9e8414a16709 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:42.243910 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2d073a11-0636-40e9-9df6-9e8414a16709 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:42.244384 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2d073a11-0636-40e9-9df6-9e8414a16709 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:42.388390 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-2d073a11-0636-40e9-9df6-9e8414a16709 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:42.402061 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-2d073a11-0636-40e9-9df6-9e8414a16709 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:42.404716 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-2d073a11-0636-40e9-9df6-9e8414a16709 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:42.406834 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-2d073a11-0636-40e9-9df6-9e8414a16709 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1408 microversion: 2.20 time: 0.177440 Sep 16 01:54:42.414499 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 83/155] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:54:42 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1408 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:54:42.464521 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-381570aa-5dec-48a2-8d18-95182b9a8917 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:42.465337 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-381570aa-5dec-48a2-8d18-95182b9a8917 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:42.472052 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-381570aa-5dec-48a2-8d18-95182b9a8917 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:42.473047 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-381570aa-5dec-48a2-8d18-95182b9a8917 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:42.473832 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-381570aa-5dec-48a2-8d18-95182b9a8917 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:42.475249 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-381570aa-5dec-48a2-8d18-95182b9a8917 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:42.475863 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-381570aa-5dec-48a2-8d18-95182b9a8917 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:42.476443 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-381570aa-5dec-48a2-8d18-95182b9a8917 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:42.638646 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-381570aa-5dec-48a2-8d18-95182b9a8917 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:42.647146 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-381570aa-5dec-48a2-8d18-95182b9a8917 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1364 microversion: 2.1 time: 0.186820 Sep 16 01:54:42.660432 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 73/156] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:42 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1364 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:42.874442 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-f35c1316-82db-438b-abd6-f4fcd6d24853 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:42.875057 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-f35c1316-82db-438b-abd6-f4fcd6d24853 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:42.881164 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f35c1316-82db-438b-abd6-f4fcd6d24853 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:42.881644 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f35c1316-82db-438b-abd6-f4fcd6d24853 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:42.882077 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f35c1316-82db-438b-abd6-f4fcd6d24853 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:42.882763 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f35c1316-82db-438b-abd6-f4fcd6d24853 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:42.883219 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f35c1316-82db-438b-abd6-f4fcd6d24853 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:42.883642 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f35c1316-82db-438b-abd6-f4fcd6d24853 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:43.007724 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-f35c1316-82db-438b-abd6-f4fcd6d24853 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:43.011278 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell1:SELECT=100 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:43.016513 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-f35c1316-82db-438b-abd6-f4fcd6d24853 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1321 microversion: 2.1 time: 0.146064 Sep 16 01:54:43.017063 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 84/157] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:42 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1321 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:43.141063 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-f98c00e9-443d-48bc-bd29-fe183d033fd6 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:43.141674 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-f98c00e9-443d-48bc-bd29-fe183d033fd6 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] [instance: 33b0ab06-b40e-4c13-a33f-cd6a2881fd16] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:43.148166 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f98c00e9-443d-48bc-bd29-fe183d033fd6 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:43.148650 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f98c00e9-443d-48bc-bd29-fe183d033fd6 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:43.149089 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f98c00e9-443d-48bc-bd29-fe183d033fd6 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:43.150110 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f98c00e9-443d-48bc-bd29-fe183d033fd6 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:43.150568 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f98c00e9-443d-48bc-bd29-fe183d033fd6 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:43.151102 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f98c00e9-443d-48bc-bd29-fe183d033fd6 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:43.287426 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-f98c00e9-443d-48bc-bd29-fe183d033fd6 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a39440ed016445a7bfc7ac7fba6661f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477dd0575c8741b0815ddf5f22297db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:43.295007 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-f98c00e9-443d-48bc-bd29-fe183d033fd6 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] 10.222.0.42 "GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16" status: 200 len: 1315 microversion: 2.1 time: 0.157808 Sep 16 01:54:43.295597 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 74/158] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:43 2022] GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16 => generated 1315 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:43.434639 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-e021f311-d10e-48a5-983e-23425e8b270c tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:43.436964 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-e021f311-d10e-48a5-983e-23425e8b270c tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:43.443706 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e021f311-d10e-48a5-983e-23425e8b270c tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:43.444555 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e021f311-d10e-48a5-983e-23425e8b270c tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:43.445085 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e021f311-d10e-48a5-983e-23425e8b270c tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:43.445984 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e021f311-d10e-48a5-983e-23425e8b270c tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:43.446529 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e021f311-d10e-48a5-983e-23425e8b270c tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:43.447204 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e021f311-d10e-48a5-983e-23425e8b270c tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:43.598366 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-e021f311-d10e-48a5-983e-23425e8b270c tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:43.606581 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-e021f311-d10e-48a5-983e-23425e8b270c tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:43.608048 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-e021f311-d10e-48a5-983e-23425e8b270c tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:43.609167 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-e021f311-d10e-48a5-983e-23425e8b270c tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1408 microversion: 2.20 time: 0.179342 Sep 16 01:54:43.609708 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 85/159] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:54:43 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1408 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:54:43.670950 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-eae6d55d-aa35-4cff-ad69-385650c35850 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:43.671753 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-eae6d55d-aa35-4cff-ad69-385650c35850 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:43.678577 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-eae6d55d-aa35-4cff-ad69-385650c35850 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:43.679112 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-eae6d55d-aa35-4cff-ad69-385650c35850 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:43.679537 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-eae6d55d-aa35-4cff-ad69-385650c35850 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:43.680314 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-eae6d55d-aa35-4cff-ad69-385650c35850 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:43.680767 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-eae6d55d-aa35-4cff-ad69-385650c35850 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:43.681179 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-eae6d55d-aa35-4cff-ad69-385650c35850 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:43.700981 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell1:SELECT=100 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:43.809025 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-eae6d55d-aa35-4cff-ad69-385650c35850 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:43.816559 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-eae6d55d-aa35-4cff-ad69-385650c35850 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1364 microversion: 2.1 time: 0.149554 Sep 16 01:54:43.817117 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 75/160] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:43 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:44.039832 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-b324b1cc-0b55-4f9f-8c27-f0977e570c1a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:44.040369 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-b324b1cc-0b55-4f9f-8c27-f0977e570c1a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:44.046245 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b324b1cc-0b55-4f9f-8c27-f0977e570c1a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:44.046725 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b324b1cc-0b55-4f9f-8c27-f0977e570c1a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:44.047155 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b324b1cc-0b55-4f9f-8c27-f0977e570c1a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:44.047833 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b324b1cc-0b55-4f9f-8c27-f0977e570c1a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:44.048310 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b324b1cc-0b55-4f9f-8c27-f0977e570c1a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:44.048728 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b324b1cc-0b55-4f9f-8c27-f0977e570c1a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:44.176300 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-b324b1cc-0b55-4f9f-8c27-f0977e570c1a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:44.184260 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-b324b1cc-0b55-4f9f-8c27-f0977e570c1a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1321 microversion: 2.1 time: 0.148336 Sep 16 01:54:44.184821 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 86/161] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:44 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1321 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:44.317237 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-d5fe6481-2786-446b-9f85-927f15e4d859 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:44.318500 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-d5fe6481-2786-446b-9f85-927f15e4d859 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] [instance: 33b0ab06-b40e-4c13-a33f-cd6a2881fd16] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:44.324646 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d5fe6481-2786-446b-9f85-927f15e4d859 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:44.325119 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d5fe6481-2786-446b-9f85-927f15e4d859 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:44.325547 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d5fe6481-2786-446b-9f85-927f15e4d859 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:44.326217 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d5fe6481-2786-446b-9f85-927f15e4d859 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:44.326657 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d5fe6481-2786-446b-9f85-927f15e4d859 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:44.327071 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d5fe6481-2786-446b-9f85-927f15e4d859 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:44.455421 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-d5fe6481-2786-446b-9f85-927f15e4d859 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a39440ed016445a7bfc7ac7fba6661f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477dd0575c8741b0815ddf5f22297db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:44.463166 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-d5fe6481-2786-446b-9f85-927f15e4d859 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] 10.222.0.42 "GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16" status: 200 len: 1315 microversion: 2.1 time: 0.149807 Sep 16 01:54:44.463732 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 76/162] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:44 2022] GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:44.635378 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-325c5338-af2c-47df-81c5-710ef59612b4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:44.636737 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-325c5338-af2c-47df-81c5-710ef59612b4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:44.644101 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-325c5338-af2c-47df-81c5-710ef59612b4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:44.644837 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-325c5338-af2c-47df-81c5-710ef59612b4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:44.645270 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-325c5338-af2c-47df-81c5-710ef59612b4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:44.646629 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-325c5338-af2c-47df-81c5-710ef59612b4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:44.647404 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-325c5338-af2c-47df-81c5-710ef59612b4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:44.647769 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-325c5338-af2c-47df-81c5-710ef59612b4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:44.803687 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-325c5338-af2c-47df-81c5-710ef59612b4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:44.816697 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-325c5338-af2c-47df-81c5-710ef59612b4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:44.818465 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-325c5338-af2c-47df-81c5-710ef59612b4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:44.819658 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-325c5338-af2c-47df-81c5-710ef59612b4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1408 microversion: 2.20 time: 0.188805 Sep 16 01:54:44.832085 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 87/163] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:54:44 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1408 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:54:44.842069 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-b12c58af-a8fa-488b-aac8-5724a33184c6 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:44.842776 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-b12c58af-a8fa-488b-aac8-5724a33184c6 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:44.848551 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b12c58af-a8fa-488b-aac8-5724a33184c6 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:44.849560 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b12c58af-a8fa-488b-aac8-5724a33184c6 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:44.850009 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b12c58af-a8fa-488b-aac8-5724a33184c6 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:44.850687 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b12c58af-a8fa-488b-aac8-5724a33184c6 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:44.851138 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b12c58af-a8fa-488b-aac8-5724a33184c6 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:44.851555 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b12c58af-a8fa-488b-aac8-5724a33184c6 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:44.984689 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-b12c58af-a8fa-488b-aac8-5724a33184c6 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:44.993194 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-b12c58af-a8fa-488b-aac8-5724a33184c6 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1364 microversion: 2.1 time: 0.154857 Sep 16 01:54:44.993764 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 77/164] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:44 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:45.207209 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-af32dbed-9af3-4b4a-b211-476e0b018e34 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:45.207902 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-af32dbed-9af3-4b4a-b211-476e0b018e34 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:45.215637 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-af32dbed-9af3-4b4a-b211-476e0b018e34 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:45.216163 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-af32dbed-9af3-4b4a-b211-476e0b018e34 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:45.216604 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-af32dbed-9af3-4b4a-b211-476e0b018e34 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:45.217298 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-af32dbed-9af3-4b4a-b211-476e0b018e34 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:45.217939 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-af32dbed-9af3-4b4a-b211-476e0b018e34 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:45.218504 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-af32dbed-9af3-4b4a-b211-476e0b018e34 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:45.351299 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-af32dbed-9af3-4b4a-b211-476e0b018e34 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:45.359016 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-af32dbed-9af3-4b4a-b211-476e0b018e34 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1321 microversion: 2.1 time: 0.156197 Sep 16 01:54:45.359569 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 88/165] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:45 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1321 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:45.485726 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-98086292-24ee-42d3-87ad-a5c1441efb8e tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:45.486443 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-98086292-24ee-42d3-87ad-a5c1441efb8e tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] [instance: 33b0ab06-b40e-4c13-a33f-cd6a2881fd16] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:45.492974 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-98086292-24ee-42d3-87ad-a5c1441efb8e tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:45.493528 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-98086292-24ee-42d3-87ad-a5c1441efb8e tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:45.494006 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-98086292-24ee-42d3-87ad-a5c1441efb8e tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:45.494741 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-98086292-24ee-42d3-87ad-a5c1441efb8e tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:45.495191 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-98086292-24ee-42d3-87ad-a5c1441efb8e tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:45.495611 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-98086292-24ee-42d3-87ad-a5c1441efb8e tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:45.680210 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-98086292-24ee-42d3-87ad-a5c1441efb8e tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a39440ed016445a7bfc7ac7fba6661f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477dd0575c8741b0815ddf5f22297db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:45.687719 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-98086292-24ee-42d3-87ad-a5c1441efb8e tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] 10.222.0.42 "GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16" status: 200 len: 1315 microversion: 2.1 time: 0.205920 Sep 16 01:54:45.688314 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 78/166] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:45 2022] GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16 => generated 1315 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:45.844248 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-d1b7b4ad-3762-4d46-9f7f-fc9910c77f24 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:45.844935 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-d1b7b4ad-3762-4d46-9f7f-fc9910c77f24 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:45.850930 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d1b7b4ad-3762-4d46-9f7f-fc9910c77f24 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:45.851413 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d1b7b4ad-3762-4d46-9f7f-fc9910c77f24 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:45.852045 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d1b7b4ad-3762-4d46-9f7f-fc9910c77f24 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:45.852969 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d1b7b4ad-3762-4d46-9f7f-fc9910c77f24 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:45.853573 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d1b7b4ad-3762-4d46-9f7f-fc9910c77f24 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:45.854316 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d1b7b4ad-3762-4d46-9f7f-fc9910c77f24 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:46.017093 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-edef91c3-2387-4c58-afce-e5c3389a4bb5 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:46.018046 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-edef91c3-2387-4c58-afce-e5c3389a4bb5 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:46.025363 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-edef91c3-2387-4c58-afce-e5c3389a4bb5 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:46.026394 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-edef91c3-2387-4c58-afce-e5c3389a4bb5 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:46.027234 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-edef91c3-2387-4c58-afce-e5c3389a4bb5 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:46.028308 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-edef91c3-2387-4c58-afce-e5c3389a4bb5 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:46.028904 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-edef91c3-2387-4c58-afce-e5c3389a4bb5 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:46.029472 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-edef91c3-2387-4c58-afce-e5c3389a4bb5 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:46.033086 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-d1b7b4ad-3762-4d46-9f7f-fc9910c77f24 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:46.042933 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-d1b7b4ad-3762-4d46-9f7f-fc9910c77f24 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:46.045631 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-d1b7b4ad-3762-4d46-9f7f-fc9910c77f24 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:46.047032 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-d1b7b4ad-3762-4d46-9f7f-fc9910c77f24 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1408 microversion: 2.20 time: 0.206565 Sep 16 01:54:46.048100 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 89/167] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:54:45 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1408 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 01:54:46.175208 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-edef91c3-2387-4c58-afce-e5c3389a4bb5 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:46.183691 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-edef91c3-2387-4c58-afce-e5c3389a4bb5 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1364 microversion: 2.1 time: 0.171019 Sep 16 01:54:46.184307 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 79/168] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:46 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1364 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 01:54:46.383381 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-ae877f22-cc19-4bb3-922d-3047f884c8a0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:46.383928 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-ae877f22-cc19-4bb3-922d-3047f884c8a0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:46.385818 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell0:SELECT=2 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:46.391084 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ae877f22-cc19-4bb3-922d-3047f884c8a0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:46.391577 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ae877f22-cc19-4bb3-922d-3047f884c8a0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:46.392048 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ae877f22-cc19-4bb3-922d-3047f884c8a0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:46.392744 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ae877f22-cc19-4bb3-922d-3047f884c8a0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:46.393203 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ae877f22-cc19-4bb3-922d-3047f884c8a0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:46.393626 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ae877f22-cc19-4bb3-922d-3047f884c8a0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:46.539355 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-ae877f22-cc19-4bb3-922d-3047f884c8a0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:46.547084 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-ae877f22-cc19-4bb3-922d-3047f884c8a0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1321 microversion: 2.1 time: 0.168329 Sep 16 01:54:46.547641 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 90/169] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:46 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1321 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:46.710722 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-b975fe95-4272-47d6-b8eb-320c1436cd82 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:46.711497 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-b975fe95-4272-47d6-b8eb-320c1436cd82 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] [instance: 33b0ab06-b40e-4c13-a33f-cd6a2881fd16] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:46.717598 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b975fe95-4272-47d6-b8eb-320c1436cd82 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:46.718297 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b975fe95-4272-47d6-b8eb-320c1436cd82 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:46.718771 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b975fe95-4272-47d6-b8eb-320c1436cd82 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:46.719459 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b975fe95-4272-47d6-b8eb-320c1436cd82 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:46.719909 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b975fe95-4272-47d6-b8eb-320c1436cd82 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:46.720355 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b975fe95-4272-47d6-b8eb-320c1436cd82 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:46.854730 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-b975fe95-4272-47d6-b8eb-320c1436cd82 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a39440ed016445a7bfc7ac7fba6661f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477dd0575c8741b0815ddf5f22297db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:46.862248 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-b975fe95-4272-47d6-b8eb-320c1436cd82 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] 10.222.0.42 "GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16" status: 200 len: 1315 microversion: 2.1 time: 0.155606 Sep 16 01:54:46.862816 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 80/170] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:46 2022] GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16 => generated 1315 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:47.073742 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-784291b1-9f47-4dd3-92d2-32cc9ca238a1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:47.074949 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-784291b1-9f47-4dd3-92d2-32cc9ca238a1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:47.092213 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-784291b1-9f47-4dd3-92d2-32cc9ca238a1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:47.092213 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-784291b1-9f47-4dd3-92d2-32cc9ca238a1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:47.092213 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-784291b1-9f47-4dd3-92d2-32cc9ca238a1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:47.092213 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-784291b1-9f47-4dd3-92d2-32cc9ca238a1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:47.092713 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-784291b1-9f47-4dd3-92d2-32cc9ca238a1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:47.092713 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-784291b1-9f47-4dd3-92d2-32cc9ca238a1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:47.206451 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-9333b1ed-c0ff-4681-88c7-9f6ce83892ae tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:47.207059 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-9333b1ed-c0ff-4681-88c7-9f6ce83892ae tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:47.213002 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9333b1ed-c0ff-4681-88c7-9f6ce83892ae tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:47.213471 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9333b1ed-c0ff-4681-88c7-9f6ce83892ae tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:47.213905 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9333b1ed-c0ff-4681-88c7-9f6ce83892ae tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:47.214582 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9333b1ed-c0ff-4681-88c7-9f6ce83892ae tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:47.215027 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9333b1ed-c0ff-4681-88c7-9f6ce83892ae tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:47.215437 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9333b1ed-c0ff-4681-88c7-9f6ce83892ae tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:47.217315 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-784291b1-9f47-4dd3-92d2-32cc9ca238a1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:47.226840 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-784291b1-9f47-4dd3-92d2-32cc9ca238a1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:47.228324 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-784291b1-9f47-4dd3-92d2-32cc9ca238a1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:47.229609 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-784291b1-9f47-4dd3-92d2-32cc9ca238a1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1408 microversion: 2.20 time: 0.160227 Sep 16 01:54:47.230166 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 91/171] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:54:47 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1408 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:54:47.366378 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-9333b1ed-c0ff-4681-88c7-9f6ce83892ae tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:47.374056 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-9333b1ed-c0ff-4681-88c7-9f6ce83892ae tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1364 microversion: 2.1 time: 0.171383 Sep 16 01:54:47.374757 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 81/172] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:47 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1364 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 01:54:47.569803 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-11628d45-8959-4013-9894-a92024d3b821 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:47.570765 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-11628d45-8959-4013-9894-a92024d3b821 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:47.572606 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_api:SELECT=99 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:47.577986 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-11628d45-8959-4013-9894-a92024d3b821 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:47.578583 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-11628d45-8959-4013-9894-a92024d3b821 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:47.579024 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-11628d45-8959-4013-9894-a92024d3b821 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:47.580318 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-11628d45-8959-4013-9894-a92024d3b821 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:47.581357 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-11628d45-8959-4013-9894-a92024d3b821 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:47.581948 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-11628d45-8959-4013-9894-a92024d3b821 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:47.721509 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-11628d45-8959-4013-9894-a92024d3b821 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:47.730295 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-11628d45-8959-4013-9894-a92024d3b821 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1321 microversion: 2.1 time: 0.164321 Sep 16 01:54:47.730907 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 92/173] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:47 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1321 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:47.886360 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-398612bc-10cf-4df3-a0f0-f7ff818e9bbf tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:47.887072 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-398612bc-10cf-4df3-a0f0-f7ff818e9bbf tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] [instance: 33b0ab06-b40e-4c13-a33f-cd6a2881fd16] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:47.892957 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-398612bc-10cf-4df3-a0f0-f7ff818e9bbf tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:47.893504 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-398612bc-10cf-4df3-a0f0-f7ff818e9bbf tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:47.893999 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-398612bc-10cf-4df3-a0f0-f7ff818e9bbf tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:47.894736 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-398612bc-10cf-4df3-a0f0-f7ff818e9bbf tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:47.895248 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-398612bc-10cf-4df3-a0f0-f7ff818e9bbf tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:47.896407 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-398612bc-10cf-4df3-a0f0-f7ff818e9bbf tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:48.042452 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-398612bc-10cf-4df3-a0f0-f7ff818e9bbf tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a39440ed016445a7bfc7ac7fba6661f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477dd0575c8741b0815ddf5f22297db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:48.050748 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-398612bc-10cf-4df3-a0f0-f7ff818e9bbf tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] 10.222.0.42 "GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16" status: 200 len: 1315 microversion: 2.1 time: 0.168228 Sep 16 01:54:48.051279 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 82/174] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:47 2022] GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16 => generated 1315 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:48.255069 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-13c4b0d8-d9ef-4110-9284-f51b8820cc37 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:48.256361 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-13c4b0d8-d9ef-4110-9284-f51b8820cc37 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:48.262466 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-13c4b0d8-d9ef-4110-9284-f51b8820cc37 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:48.263041 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-13c4b0d8-d9ef-4110-9284-f51b8820cc37 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:48.263478 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-13c4b0d8-d9ef-4110-9284-f51b8820cc37 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:48.264199 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-13c4b0d8-d9ef-4110-9284-f51b8820cc37 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:48.264763 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-13c4b0d8-d9ef-4110-9284-f51b8820cc37 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:48.265188 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-13c4b0d8-d9ef-4110-9284-f51b8820cc37 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:48.398001 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-13c4b0d8-d9ef-4110-9284-f51b8820cc37 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:48.401040 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-5ead2e0b-752d-48c2-b15c-2227b721e7b7 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:48.401725 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-5ead2e0b-752d-48c2-b15c-2227b721e7b7 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:48.406774 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-13c4b0d8-d9ef-4110-9284-f51b8820cc37 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:48.408009 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-5ead2e0b-752d-48c2-b15c-2227b721e7b7 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:48.408225 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-13c4b0d8-d9ef-4110-9284-f51b8820cc37 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:48.408648 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-5ead2e0b-752d-48c2-b15c-2227b721e7b7 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:48.409151 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-5ead2e0b-752d-48c2-b15c-2227b721e7b7 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:48.409324 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-13c4b0d8-d9ef-4110-9284-f51b8820cc37 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1408 microversion: 2.20 time: 0.158493 Sep 16 01:54:48.409870 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 93/175] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:54:48 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1408 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:54:48.410003 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-5ead2e0b-752d-48c2-b15c-2227b721e7b7 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:48.410458 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-5ead2e0b-752d-48c2-b15c-2227b721e7b7 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:48.410881 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-5ead2e0b-752d-48c2-b15c-2227b721e7b7 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:48.548584 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-5ead2e0b-752d-48c2-b15c-2227b721e7b7 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:48.556314 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-5ead2e0b-752d-48c2-b15c-2227b721e7b7 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1364 microversion: 2.1 time: 0.162560 Sep 16 01:54:48.556882 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 83/176] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:48 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 01:54:48.752819 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-8146633c-0917-49e5-8230-7279a0e6218c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:48.753677 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-8146633c-0917-49e5-8230-7279a0e6218c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:48.762017 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8146633c-0917-49e5-8230-7279a0e6218c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:48.762305 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8146633c-0917-49e5-8230-7279a0e6218c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:48.762965 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8146633c-0917-49e5-8230-7279a0e6218c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:48.763776 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8146633c-0917-49e5-8230-7279a0e6218c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:48.764543 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8146633c-0917-49e5-8230-7279a0e6218c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:48.765089 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8146633c-0917-49e5-8230-7279a0e6218c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:48.906907 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-8146633c-0917-49e5-8230-7279a0e6218c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:48.914819 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-8146633c-0917-49e5-8230-7279a0e6218c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1321 microversion: 2.1 time: 0.165742 Sep 16 01:54:48.915361 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 94/177] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:48 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1321 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:49.075199 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-d7e951ce-ca0a-4e19-b2a3-647bc3a12c67 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:49.075812 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-d7e951ce-ca0a-4e19-b2a3-647bc3a12c67 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] [instance: 33b0ab06-b40e-4c13-a33f-cd6a2881fd16] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:49.085763 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d7e951ce-ca0a-4e19-b2a3-647bc3a12c67 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:49.086648 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d7e951ce-ca0a-4e19-b2a3-647bc3a12c67 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:49.087440 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d7e951ce-ca0a-4e19-b2a3-647bc3a12c67 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:49.088505 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d7e951ce-ca0a-4e19-b2a3-647bc3a12c67 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:49.088968 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d7e951ce-ca0a-4e19-b2a3-647bc3a12c67 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:49.089573 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d7e951ce-ca0a-4e19-b2a3-647bc3a12c67 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:49.229790 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-d7e951ce-ca0a-4e19-b2a3-647bc3a12c67 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a39440ed016445a7bfc7ac7fba6661f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477dd0575c8741b0815ddf5f22297db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:49.240846 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-d7e951ce-ca0a-4e19-b2a3-647bc3a12c67 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] 10.222.0.42 "GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16" status: 200 len: 1315 microversion: 2.1 time: 0.169774 Sep 16 01:54:49.241784 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 84/178] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:49 2022] GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:49.435622 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-5de349e6-01c9-4971-bf19-c47ec168e61a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:49.436258 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-5de349e6-01c9-4971-bf19-c47ec168e61a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:49.442177 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5de349e6-01c9-4971-bf19-c47ec168e61a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:49.443173 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5de349e6-01c9-4971-bf19-c47ec168e61a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:49.443600 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5de349e6-01c9-4971-bf19-c47ec168e61a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:49.444370 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5de349e6-01c9-4971-bf19-c47ec168e61a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:49.444819 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5de349e6-01c9-4971-bf19-c47ec168e61a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:49.445240 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5de349e6-01c9-4971-bf19-c47ec168e61a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:49.580714 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-d502de24-d35c-4e7d-a0e6-c0251bd8a398 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:49.581518 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-d502de24-d35c-4e7d-a0e6-c0251bd8a398 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:49.584482 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-5de349e6-01c9-4971-bf19-c47ec168e61a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:49.592849 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d502de24-d35c-4e7d-a0e6-c0251bd8a398 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:49.593538 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d502de24-d35c-4e7d-a0e6-c0251bd8a398 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:49.594007 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d502de24-d35c-4e7d-a0e6-c0251bd8a398 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:49.594716 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d502de24-d35c-4e7d-a0e6-c0251bd8a398 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:49.595202 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d502de24-d35c-4e7d-a0e6-c0251bd8a398 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:49.595627 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d502de24-d35c-4e7d-a0e6-c0251bd8a398 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:49.598164 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-5de349e6-01c9-4971-bf19-c47ec168e61a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:49.601136 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-5de349e6-01c9-4971-bf19-c47ec168e61a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:49.602651 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-5de349e6-01c9-4971-bf19-c47ec168e61a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1408 microversion: 2.20 time: 0.170672 Sep 16 01:54:49.612312 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 95/179] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:54:49 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1408 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:54:49.742947 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-d502de24-d35c-4e7d-a0e6-c0251bd8a398 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:49.750753 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-d502de24-d35c-4e7d-a0e6-c0251bd8a398 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1364 microversion: 2.1 time: 0.174870 Sep 16 01:54:49.751473 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 85/180] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:49 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1364 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:49.941648 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-cb1e8d48-dac9-4de5-befa-3bc66590bc66 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:49.943649 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-cb1e8d48-dac9-4de5-befa-3bc66590bc66 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:49.951109 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-cb1e8d48-dac9-4de5-befa-3bc66590bc66 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:49.951798 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-cb1e8d48-dac9-4de5-befa-3bc66590bc66 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:49.952466 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-cb1e8d48-dac9-4de5-befa-3bc66590bc66 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:49.953866 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-cb1e8d48-dac9-4de5-befa-3bc66590bc66 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:49.954607 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-cb1e8d48-dac9-4de5-befa-3bc66590bc66 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:49.955247 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-cb1e8d48-dac9-4de5-befa-3bc66590bc66 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:49.980585 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [req-bc37dd3c-cc86-4620-a7ac-92e96167d45d req-ed9f26d3-2f6d-477d-8a8c-3e3388ad45f3 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e390b45-0b39-4429-9431-7ee6af3806e6", "name": "network-vif-plugged", "status": "completed", "tag": "dc91b77b-583a-4740-a244-adc53daa4347"}]} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:54:50.006759 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-bc37dd3c-cc86-4620-a7ac-92e96167d45d req-ed9f26d3-2f6d-477d-8a8c-3e3388ad45f3 service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:50.008625 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-bc37dd3c-cc86-4620-a7ac-92e96167d45d req-ed9f26d3-2f6d-477d-8a8c-3e3388ad45f3 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:50.009599 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-bc37dd3c-cc86-4620-a7ac-92e96167d45d req-ed9f26d3-2f6d-477d-8a8c-3e3388ad45f3 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:50.044368 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.compute.server_external_events [req-bc37dd3c-cc86-4620-a7ac-92e96167d45d req-ed9f26d3-2f6d-477d-8a8c-3e3388ad45f3 service nova] Creating event network-vif-plugged:dc91b77b-583a-4740-a244-adc53daa4347 for instance 3e390b45-0b39-4429-9431-7ee6af3806e6 on hv-cinder-84914 Sep 16 01:54:50.059675 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [req-bc37dd3c-cc86-4620-a7ac-92e96167d45d req-ed9f26d3-2f6d-477d-8a8c-3e3388ad45f3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098876 Sep 16 01:54:50.061423 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 86/181] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 01:54:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:54:50.177519 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-cb1e8d48-dac9-4de5-befa-3bc66590bc66 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:50.185660 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-cb1e8d48-dac9-4de5-befa-3bc66590bc66 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1321 microversion: 2.1 time: 0.250900 Sep 16 01:54:50.186686 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 96/182] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:49 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1321 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:50.268357 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-4ed2a4a1-0b42-4442-ad52-e4fd00f17b35 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:50.269847 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-4ed2a4a1-0b42-4442-ad52-e4fd00f17b35 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] [instance: 33b0ab06-b40e-4c13-a33f-cd6a2881fd16] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:50.284933 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-4ed2a4a1-0b42-4442-ad52-e4fd00f17b35 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:50.285595 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-4ed2a4a1-0b42-4442-ad52-e4fd00f17b35 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:50.286403 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-4ed2a4a1-0b42-4442-ad52-e4fd00f17b35 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:50.288328 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-4ed2a4a1-0b42-4442-ad52-e4fd00f17b35 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:50.288937 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-4ed2a4a1-0b42-4442-ad52-e4fd00f17b35 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:50.289534 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-4ed2a4a1-0b42-4442-ad52-e4fd00f17b35 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:50.499885 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-4ed2a4a1-0b42-4442-ad52-e4fd00f17b35 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a39440ed016445a7bfc7ac7fba6661f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477dd0575c8741b0815ddf5f22297db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:50.508251 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-4ed2a4a1-0b42-4442-ad52-e4fd00f17b35 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] 10.222.0.42 "GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16" status: 200 len: 1315 microversion: 2.1 time: 0.245598 Sep 16 01:54:50.509070 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 87/183] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:50 2022] GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16 => generated 1315 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:50.627820 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-62b04bd2-ee72-4bb7-9a2a-c5a7c020d2c3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:50.628568 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-62b04bd2-ee72-4bb7-9a2a-c5a7c020d2c3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:50.635740 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-62b04bd2-ee72-4bb7-9a2a-c5a7c020d2c3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:50.636327 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-62b04bd2-ee72-4bb7-9a2a-c5a7c020d2c3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:50.636767 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-62b04bd2-ee72-4bb7-9a2a-c5a7c020d2c3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:50.637493 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-62b04bd2-ee72-4bb7-9a2a-c5a7c020d2c3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:50.637941 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-62b04bd2-ee72-4bb7-9a2a-c5a7c020d2c3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:50.638363 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-62b04bd2-ee72-4bb7-9a2a-c5a7c020d2c3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:50.768684 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-62b04bd2-ee72-4bb7-9a2a-c5a7c020d2c3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:50.774843 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-446b0fb9-f715-49fa-b25d-553a47dc58c4 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:50.775504 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-446b0fb9-f715-49fa-b25d-553a47dc58c4 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:50.777396 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-62b04bd2-ee72-4bb7-9a2a-c5a7c020d2c3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:50.778858 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-62b04bd2-ee72-4bb7-9a2a-c5a7c020d2c3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:50.779997 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-62b04bd2-ee72-4bb7-9a2a-c5a7c020d2c3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1408 microversion: 2.20 time: 0.156079 Sep 16 01:54:50.780553 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 97/184] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:54:50 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1408 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:54:50.781596 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-446b0fb9-f715-49fa-b25d-553a47dc58c4 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:50.782077 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-446b0fb9-f715-49fa-b25d-553a47dc58c4 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:50.782508 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-446b0fb9-f715-49fa-b25d-553a47dc58c4 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:50.783187 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-446b0fb9-f715-49fa-b25d-553a47dc58c4 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:50.783633 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-446b0fb9-f715-49fa-b25d-553a47dc58c4 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:50.784080 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-446b0fb9-f715-49fa-b25d-553a47dc58c4 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:50.919475 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-446b0fb9-f715-49fa-b25d-553a47dc58c4 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:50.927664 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-446b0fb9-f715-49fa-b25d-553a47dc58c4 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1364 microversion: 2.1 time: 0.156275 Sep 16 01:54:50.928473 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 88/185] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:50 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 01:54:51.210990 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-33a54cd4-d81c-4490-a04e-19d01516a668 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:51.211665 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-33a54cd4-d81c-4490-a04e-19d01516a668 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:51.220847 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-33a54cd4-d81c-4490-a04e-19d01516a668 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:51.221327 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-33a54cd4-d81c-4490-a04e-19d01516a668 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:51.221756 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-33a54cd4-d81c-4490-a04e-19d01516a668 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:51.222572 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-33a54cd4-d81c-4490-a04e-19d01516a668 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:51.223020 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-33a54cd4-d81c-4490-a04e-19d01516a668 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:51.223435 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-33a54cd4-d81c-4490-a04e-19d01516a668 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:51.383082 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-33a54cd4-d81c-4490-a04e-19d01516a668 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:51.391834 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-33a54cd4-d81c-4490-a04e-19d01516a668 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1321 microversion: 2.1 time: 0.185126 Sep 16 01:54:51.392488 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 98/186] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:51 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1321 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:51.533276 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-0d97344c-d93b-450e-9263-ffeb91661223 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:51.534371 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-0d97344c-d93b-450e-9263-ffeb91661223 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] [instance: 33b0ab06-b40e-4c13-a33f-cd6a2881fd16] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:51.542892 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0d97344c-d93b-450e-9263-ffeb91661223 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:51.543304 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0d97344c-d93b-450e-9263-ffeb91661223 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:51.544137 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0d97344c-d93b-450e-9263-ffeb91661223 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:51.544890 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0d97344c-d93b-450e-9263-ffeb91661223 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:51.545344 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0d97344c-d93b-450e-9263-ffeb91661223 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:51.545795 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0d97344c-d93b-450e-9263-ffeb91661223 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:51.728978 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-0d97344c-d93b-450e-9263-ffeb91661223 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a39440ed016445a7bfc7ac7fba6661f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477dd0575c8741b0815ddf5f22297db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:51.751590 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-0d97344c-d93b-450e-9263-ffeb91661223 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] 10.222.0.42 "GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16" status: 200 len: 1315 microversion: 2.1 time: 0.222821 Sep 16 01:54:51.756238 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 89/187] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:51 2022] GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16 => generated 1315 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:51.806364 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-92812d3b-fc62-4c12-8d6b-321f570dc91f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:51.807475 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-92812d3b-fc62-4c12-8d6b-321f570dc91f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:51.820947 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-92812d3b-fc62-4c12-8d6b-321f570dc91f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:51.821765 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-92812d3b-fc62-4c12-8d6b-321f570dc91f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:51.822427 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-92812d3b-fc62-4c12-8d6b-321f570dc91f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:51.823275 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-92812d3b-fc62-4c12-8d6b-321f570dc91f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:51.823733 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-92812d3b-fc62-4c12-8d6b-321f570dc91f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:51.824292 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-92812d3b-fc62-4c12-8d6b-321f570dc91f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:51.949975 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-b63c5d16-5b9e-4101-bef3-7e6212d0d147 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:51.952260 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-b63c5d16-5b9e-4101-bef3-7e6212d0d147 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:51.965813 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b63c5d16-5b9e-4101-bef3-7e6212d0d147 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:51.967287 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b63c5d16-5b9e-4101-bef3-7e6212d0d147 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:51.969406 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b63c5d16-5b9e-4101-bef3-7e6212d0d147 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:51.970465 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b63c5d16-5b9e-4101-bef3-7e6212d0d147 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:51.970940 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b63c5d16-5b9e-4101-bef3-7e6212d0d147 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:51.971370 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b63c5d16-5b9e-4101-bef3-7e6212d0d147 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:52.104057 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-92812d3b-fc62-4c12-8d6b-321f570dc91f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:52.120170 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-92812d3b-fc62-4c12-8d6b-321f570dc91f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:52.125224 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-92812d3b-fc62-4c12-8d6b-321f570dc91f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:52.130758 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-92812d3b-fc62-4c12-8d6b-321f570dc91f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1408 microversion: 2.20 time: 0.329354 Sep 16 01:54:52.131907 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 99/188] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:54:51 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1408 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:54:52.193550 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-b63c5d16-5b9e-4101-bef3-7e6212d0d147 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:52.203572 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-b63c5d16-5b9e-4101-bef3-7e6212d0d147 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1364 microversion: 2.1 time: 0.257443 Sep 16 01:54:52.204935 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 90/189] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:51 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1364 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:52.419205 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-7e3d7cc5-c7ed-4ce8-943f-e55832aba802 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:52.420389 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-7e3d7cc5-c7ed-4ce8-943f-e55832aba802 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:52.429027 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7e3d7cc5-c7ed-4ce8-943f-e55832aba802 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:52.429609 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7e3d7cc5-c7ed-4ce8-943f-e55832aba802 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:52.430351 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7e3d7cc5-c7ed-4ce8-943f-e55832aba802 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:52.431151 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7e3d7cc5-c7ed-4ce8-943f-e55832aba802 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:52.431683 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7e3d7cc5-c7ed-4ce8-943f-e55832aba802 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:52.432203 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7e3d7cc5-c7ed-4ce8-943f-e55832aba802 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:52.732733 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-7e3d7cc5-c7ed-4ce8-943f-e55832aba802 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:52.743989 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-7e3d7cc5-c7ed-4ce8-943f-e55832aba802 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1321 microversion: 2.1 time: 0.329295 Sep 16 01:54:52.745926 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 100/190] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:52 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1321 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:52.781049 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-6c8a8efe-72ae-4bcc-8c38-2f6deb5bde9d tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:52.782928 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-6c8a8efe-72ae-4bcc-8c38-2f6deb5bde9d tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] [instance: 33b0ab06-b40e-4c13-a33f-cd6a2881fd16] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:52.807674 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6c8a8efe-72ae-4bcc-8c38-2f6deb5bde9d tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:52.808162 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6c8a8efe-72ae-4bcc-8c38-2f6deb5bde9d tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:52.809232 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6c8a8efe-72ae-4bcc-8c38-2f6deb5bde9d tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:52.810837 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6c8a8efe-72ae-4bcc-8c38-2f6deb5bde9d tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:52.811294 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6c8a8efe-72ae-4bcc-8c38-2f6deb5bde9d tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:52.811909 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6c8a8efe-72ae-4bcc-8c38-2f6deb5bde9d tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:53.120774 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-6c8a8efe-72ae-4bcc-8c38-2f6deb5bde9d tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a39440ed016445a7bfc7ac7fba6661f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477dd0575c8741b0815ddf5f22297db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:53.137762 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-6c8a8efe-72ae-4bcc-8c38-2f6deb5bde9d tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] 10.222.0.42 "GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16" status: 200 len: 1315 microversion: 2.1 time: 0.362662 Sep 16 01:54:53.138350 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 91/191] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:52 2022] GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16 => generated 1315 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:53.168418 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-9157c3c6-30a7-4fe0-a799-ff678d372a0a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:53.169033 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-9157c3c6-30a7-4fe0-a799-ff678d372a0a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:53.182623 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9157c3c6-30a7-4fe0-a799-ff678d372a0a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:53.183099 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9157c3c6-30a7-4fe0-a799-ff678d372a0a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:53.184806 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9157c3c6-30a7-4fe0-a799-ff678d372a0a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:53.185533 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9157c3c6-30a7-4fe0-a799-ff678d372a0a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:53.185993 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9157c3c6-30a7-4fe0-a799-ff678d372a0a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:53.186417 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9157c3c6-30a7-4fe0-a799-ff678d372a0a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:53.230349 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-546172e2-ca89-425b-85fd-392d490fc558 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:53.230966 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-546172e2-ca89-425b-85fd-392d490fc558 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:53.252395 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell1:SELECT=100 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:53.261218 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-546172e2-ca89-425b-85fd-392d490fc558 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:53.266040 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-546172e2-ca89-425b-85fd-392d490fc558 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:53.268093 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-546172e2-ca89-425b-85fd-392d490fc558 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:53.273545 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-546172e2-ca89-425b-85fd-392d490fc558 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:53.274564 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-546172e2-ca89-425b-85fd-392d490fc558 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:53.280631 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-546172e2-ca89-425b-85fd-392d490fc558 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:53.498204 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-546172e2-ca89-425b-85fd-392d490fc558 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:53.503982 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell1:SELECT=100 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:53.507476 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-546172e2-ca89-425b-85fd-392d490fc558 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1364 microversion: 2.1 time: 0.280884 Sep 16 01:54:53.508557 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 92/192] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:53 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1364 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 01:54:53.626976 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-9157c3c6-30a7-4fe0-a799-ff678d372a0a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:53.636786 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-9157c3c6-30a7-4fe0-a799-ff678d372a0a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:53.638242 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-9157c3c6-30a7-4fe0-a799-ff678d372a0a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:53.639350 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-9157c3c6-30a7-4fe0-a799-ff678d372a0a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1408 microversion: 2.20 time: 0.478461 Sep 16 01:54:53.639909 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 101/193] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:54:53 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1408 bytes in 480 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:54:53.774536 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-8ccec032-b7e1-4f32-a223-88f21d4d0230 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:53.775151 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-8ccec032-b7e1-4f32-a223-88f21d4d0230 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:53.784854 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8ccec032-b7e1-4f32-a223-88f21d4d0230 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:53.785496 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8ccec032-b7e1-4f32-a223-88f21d4d0230 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:53.785748 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8ccec032-b7e1-4f32-a223-88f21d4d0230 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:53.788671 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8ccec032-b7e1-4f32-a223-88f21d4d0230 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:53.790780 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8ccec032-b7e1-4f32-a223-88f21d4d0230 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:53.791430 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8ccec032-b7e1-4f32-a223-88f21d4d0230 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:54.059011 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-8ccec032-b7e1-4f32-a223-88f21d4d0230 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:54.077312 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-8ccec032-b7e1-4f32-a223-88f21d4d0230 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1321 microversion: 2.1 time: 0.307030 Sep 16 01:54:54.097044 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 93/194] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:53 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1321 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:54.179862 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-04cafd3b-15e8-4e1d-abe0-9f2043294613 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:54.184262 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-04cafd3b-15e8-4e1d-abe0-9f2043294613 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] [instance: 33b0ab06-b40e-4c13-a33f-cd6a2881fd16] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:54.193998 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-04cafd3b-15e8-4e1d-abe0-9f2043294613 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:54.195059 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-04cafd3b-15e8-4e1d-abe0-9f2043294613 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:54.195773 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-04cafd3b-15e8-4e1d-abe0-9f2043294613 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:54.196704 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-04cafd3b-15e8-4e1d-abe0-9f2043294613 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:54.197475 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-04cafd3b-15e8-4e1d-abe0-9f2043294613 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:54.198176 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-04cafd3b-15e8-4e1d-abe0-9f2043294613 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:54.316663 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [req-71b88041-a34d-4fb9-9966-55a39454c5a9 req-4bf15c03-79ba-4c9c-bd24-e6714ccc880f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48c9b577-5e65-464f-9328-da6dc694277c", "name": "network-vif-plugged", "status": "completed", "tag": "6bf23a1f-07f6-4b96-abf5-7191389578be"}]} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:54:54.340143 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-71b88041-a34d-4fb9-9966-55a39454c5a9 req-4bf15c03-79ba-4c9c-bd24-e6714ccc880f service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:54.341026 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-71b88041-a34d-4fb9-9966-55a39454c5a9 req-4bf15c03-79ba-4c9c-bd24-e6714ccc880f service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:54.341458 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-71b88041-a34d-4fb9-9966-55a39454c5a9 req-4bf15c03-79ba-4c9c-bd24-e6714ccc880f service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:54.358219 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.compute.server_external_events [req-71b88041-a34d-4fb9-9966-55a39454c5a9 req-4bf15c03-79ba-4c9c-bd24-e6714ccc880f service nova] Creating event network-vif-plugged:6bf23a1f-07f6-4b96-abf5-7191389578be for instance 48c9b577-5e65-464f-9328-da6dc694277c on hv-cinder-84914 Sep 16 01:54:54.369964 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [req-71b88041-a34d-4fb9-9966-55a39454c5a9 req-4bf15c03-79ba-4c9c-bd24-e6714ccc880f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.059060 Sep 16 01:54:54.371361 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 94/195] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 01:54:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:54:54.507717 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-04cafd3b-15e8-4e1d-abe0-9f2043294613 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a39440ed016445a7bfc7ac7fba6661f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477dd0575c8741b0815ddf5f22297db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:54.522755 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-04cafd3b-15e8-4e1d-abe0-9f2043294613 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] 10.222.0.42 "GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16" status: 200 len: 1315 microversion: 2.1 time: 0.362745 Sep 16 01:54:54.524854 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 102/196] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:54 2022] GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16 => generated 1315 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:54.542311 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-42c8f6f8-f9f4-4c4d-b755-bb77758ba819 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:54.543181 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-42c8f6f8-f9f4-4c4d-b755-bb77758ba819 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:54.557343 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-42c8f6f8-f9f4-4c4d-b755-bb77758ba819 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:54.557835 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-42c8f6f8-f9f4-4c4d-b755-bb77758ba819 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:54.559825 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-42c8f6f8-f9f4-4c4d-b755-bb77758ba819 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:54.560897 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-42c8f6f8-f9f4-4c4d-b755-bb77758ba819 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:54.563369 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-42c8f6f8-f9f4-4c4d-b755-bb77758ba819 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:54.564042 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-42c8f6f8-f9f4-4c4d-b755-bb77758ba819 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:54.667577 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-ff7f2e81-14fb-4815-86a2-2fd9e1460256 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:54.668219 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-ff7f2e81-14fb-4815-86a2-2fd9e1460256 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:54.684084 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ff7f2e81-14fb-4815-86a2-2fd9e1460256 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:54.684576 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ff7f2e81-14fb-4815-86a2-2fd9e1460256 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:54.686852 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ff7f2e81-14fb-4815-86a2-2fd9e1460256 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:54.687577 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ff7f2e81-14fb-4815-86a2-2fd9e1460256 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:54.689304 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ff7f2e81-14fb-4815-86a2-2fd9e1460256 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:54.691830 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ff7f2e81-14fb-4815-86a2-2fd9e1460256 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:54.725004 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-42c8f6f8-f9f4-4c4d-b755-bb77758ba819 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:54.734997 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-42c8f6f8-f9f4-4c4d-b755-bb77758ba819 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1364 microversion: 2.1 time: 0.207089 Sep 16 01:54:54.760752 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 95/197] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:54 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1364 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:54.970059 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-ff7f2e81-14fb-4815-86a2-2fd9e1460256 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:54.980174 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-ff7f2e81-14fb-4815-86a2-2fd9e1460256 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:54.981617 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-ff7f2e81-14fb-4815-86a2-2fd9e1460256 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:54.982729 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-ff7f2e81-14fb-4815-86a2-2fd9e1460256 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1408 microversion: 2.20 time: 0.320619 Sep 16 01:54:54.983282 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 103/198] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:54:54 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1408 bytes in 322 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 01:54:55.110148 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-3fe7877f-cdd1-45c8-b756-ff84bcf97a07 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:55.110760 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-3fe7877f-cdd1-45c8-b756-ff84bcf97a07 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:55.118404 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3fe7877f-cdd1-45c8-b756-ff84bcf97a07 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:55.119513 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3fe7877f-cdd1-45c8-b756-ff84bcf97a07 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:55.120457 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3fe7877f-cdd1-45c8-b756-ff84bcf97a07 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:55.121708 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3fe7877f-cdd1-45c8-b756-ff84bcf97a07 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:55.122370 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3fe7877f-cdd1-45c8-b756-ff84bcf97a07 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:55.122940 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3fe7877f-cdd1-45c8-b756-ff84bcf97a07 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:55.288390 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-3fe7877f-cdd1-45c8-b756-ff84bcf97a07 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:55.296747 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-3fe7877f-cdd1-45c8-b756-ff84bcf97a07 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1321 microversion: 2.1 time: 0.190719 Sep 16 01:54:55.298507 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 96/199] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:55 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1321 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:55.553545 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-edc06e40-24a2-4e8d-92e6-8899da2c8958 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:55.555230 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-edc06e40-24a2-4e8d-92e6-8899da2c8958 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] [instance: 33b0ab06-b40e-4c13-a33f-cd6a2881fd16] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:55.564040 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-edc06e40-24a2-4e8d-92e6-8899da2c8958 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:55.564536 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-edc06e40-24a2-4e8d-92e6-8899da2c8958 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:55.565113 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-edc06e40-24a2-4e8d-92e6-8899da2c8958 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:55.565838 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-edc06e40-24a2-4e8d-92e6-8899da2c8958 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:55.566409 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-edc06e40-24a2-4e8d-92e6-8899da2c8958 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:55.566927 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-edc06e40-24a2-4e8d-92e6-8899da2c8958 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:55.761212 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-a9a500dc-5cb7-4741-85a6-f9dc2b5b037c tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:55.762149 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-a9a500dc-5cb7-4741-85a6-f9dc2b5b037c tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:55.773003 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a9a500dc-5cb7-4741-85a6-f9dc2b5b037c tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:55.773781 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a9a500dc-5cb7-4741-85a6-f9dc2b5b037c tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:55.774659 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a9a500dc-5cb7-4741-85a6-f9dc2b5b037c tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:55.775614 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a9a500dc-5cb7-4741-85a6-f9dc2b5b037c tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:55.777101 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a9a500dc-5cb7-4741-85a6-f9dc2b5b037c tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:55.782197 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a9a500dc-5cb7-4741-85a6-f9dc2b5b037c tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:55.840155 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-edc06e40-24a2-4e8d-92e6-8899da2c8958 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a39440ed016445a7bfc7ac7fba6661f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477dd0575c8741b0815ddf5f22297db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:55.852265 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-edc06e40-24a2-4e8d-92e6-8899da2c8958 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] 10.222.0.42 "GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16" status: 200 len: 1315 microversion: 2.1 time: 0.308772 Sep 16 01:54:55.854387 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 104/200] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:55 2022] GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16 => generated 1315 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:56.016195 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-e8631dbb-c7f8-4a79-9f80-b786f23c13bd tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:56.016984 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-e8631dbb-c7f8-4a79-9f80-b786f23c13bd tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:56.027897 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e8631dbb-c7f8-4a79-9f80-b786f23c13bd tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:56.028701 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e8631dbb-c7f8-4a79-9f80-b786f23c13bd tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:56.029295 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e8631dbb-c7f8-4a79-9f80-b786f23c13bd tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:56.031609 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e8631dbb-c7f8-4a79-9f80-b786f23c13bd tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:56.031900 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-a9a500dc-5cb7-4741-85a6-f9dc2b5b037c tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:56.032781 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e8631dbb-c7f8-4a79-9f80-b786f23c13bd tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:56.033679 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e8631dbb-c7f8-4a79-9f80-b786f23c13bd tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:56.043089 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-a9a500dc-5cb7-4741-85a6-f9dc2b5b037c tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1364 microversion: 2.1 time: 0.288742 Sep 16 01:54:56.043676 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 97/201] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:55 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1364 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:56.326190 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-f3ea7580-5772-41e1-9648-0de17e1d5c09 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:56.327078 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-f3ea7580-5772-41e1-9648-0de17e1d5c09 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:56.338024 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f3ea7580-5772-41e1-9648-0de17e1d5c09 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:56.338975 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f3ea7580-5772-41e1-9648-0de17e1d5c09 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:56.339662 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f3ea7580-5772-41e1-9648-0de17e1d5c09 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:56.340803 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f3ea7580-5772-41e1-9648-0de17e1d5c09 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:56.342432 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f3ea7580-5772-41e1-9648-0de17e1d5c09 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:56.343140 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f3ea7580-5772-41e1-9648-0de17e1d5c09 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:56.398363 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-e8631dbb-c7f8-4a79-9f80-b786f23c13bd tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:56.414431 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-e8631dbb-c7f8-4a79-9f80-b786f23c13bd tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:56.430188 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-e8631dbb-c7f8-4a79-9f80-b786f23c13bd tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:56.437941 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-e8631dbb-c7f8-4a79-9f80-b786f23c13bd tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1408 microversion: 2.20 time: 0.426865 Sep 16 01:54:56.438532 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 105/202] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:54:56 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1408 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 01:54:56.523681 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [req-31d3b0df-e6d2-47c6-bf32-10f0566756f3 req-ad1fdd6c-c349-41e2-8785-5272534db67e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df8bdee8-15d2-4b18-a2d0-8b24b43f6763", "name": "network-vif-plugged", "status": "completed", "tag": "32e8d554-2d45-428d-8c7c-03347e83c61a"}]} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:54:56.538567 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-31d3b0df-e6d2-47c6-bf32-10f0566756f3 req-ad1fdd6c-c349-41e2-8785-5272534db67e service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:56.540088 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-31d3b0df-e6d2-47c6-bf32-10f0566756f3 req-ad1fdd6c-c349-41e2-8785-5272534db67e service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:56.542395 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-31d3b0df-e6d2-47c6-bf32-10f0566756f3 req-ad1fdd6c-c349-41e2-8785-5272534db67e service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:56.562930 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.compute.server_external_events [req-31d3b0df-e6d2-47c6-bf32-10f0566756f3 req-ad1fdd6c-c349-41e2-8785-5272534db67e service nova] Creating event network-vif-plugged:32e8d554-2d45-428d-8c7c-03347e83c61a for instance df8bdee8-15d2-4b18-a2d0-8b24b43f6763 on hv-cinder-84914 Sep 16 01:54:56.573394 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [req-31d3b0df-e6d2-47c6-bf32-10f0566756f3 req-ad1fdd6c-c349-41e2-8785-5272534db67e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055475 Sep 16 01:54:56.575161 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 106/203] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 01:54:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:54:56.651183 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-f3ea7580-5772-41e1-9648-0de17e1d5c09 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:56.662904 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-f3ea7580-5772-41e1-9648-0de17e1d5c09 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1321 microversion: 2.1 time: 0.343856 Sep 16 01:54:56.665961 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 98/204] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:56 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1321 bytes in 348 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:56.877998 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-481cbf97-a25a-449d-9f1c-2834f52c0245 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:56.878942 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-481cbf97-a25a-449d-9f1c-2834f52c0245 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] [instance: 33b0ab06-b40e-4c13-a33f-cd6a2881fd16] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:56.892227 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-481cbf97-a25a-449d-9f1c-2834f52c0245 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:56.893049 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-481cbf97-a25a-449d-9f1c-2834f52c0245 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:56.893695 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-481cbf97-a25a-449d-9f1c-2834f52c0245 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:56.894631 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-481cbf97-a25a-449d-9f1c-2834f52c0245 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:56.896738 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-481cbf97-a25a-449d-9f1c-2834f52c0245 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:56.897522 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-481cbf97-a25a-449d-9f1c-2834f52c0245 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:57.072440 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-f42e5aa7-5043-40ad-8e2c-4395a6da8c7c tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:57.074241 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-f42e5aa7-5043-40ad-8e2c-4395a6da8c7c tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:57.082537 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_api:SELECT=100 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:54:57.084474 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f42e5aa7-5043-40ad-8e2c-4395a6da8c7c tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:57.085416 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f42e5aa7-5043-40ad-8e2c-4395a6da8c7c tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:57.086024 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f42e5aa7-5043-40ad-8e2c-4395a6da8c7c tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:57.086887 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f42e5aa7-5043-40ad-8e2c-4395a6da8c7c tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:57.087495 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f42e5aa7-5043-40ad-8e2c-4395a6da8c7c tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:57.088222 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f42e5aa7-5043-40ad-8e2c-4395a6da8c7c tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:57.103338 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-481cbf97-a25a-449d-9f1c-2834f52c0245 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a39440ed016445a7bfc7ac7fba6661f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477dd0575c8741b0815ddf5f22297db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:57.118045 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-481cbf97-a25a-449d-9f1c-2834f52c0245 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] 10.222.0.42 "GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16" status: 200 len: 1501 microversion: 2.1 time: 0.245200 Sep 16 01:54:57.120070 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 107/205] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:56 2022] GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16 => generated 1501 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:57.273813 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-f42e5aa7-5043-40ad-8e2c-4395a6da8c7c tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:57.290651 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-f42e5aa7-5043-40ad-8e2c-4395a6da8c7c tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1364 microversion: 2.1 time: 0.225694 Sep 16 01:54:57.291748 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 99/206] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:57 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1364 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 01:54:57.466531 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-a346ab5e-ad2d-4b7b-bc9f-83bd82f10d71 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:57.467305 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-a346ab5e-ad2d-4b7b-bc9f-83bd82f10d71 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:57.481604 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a346ab5e-ad2d-4b7b-bc9f-83bd82f10d71 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:57.482581 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a346ab5e-ad2d-4b7b-bc9f-83bd82f10d71 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:57.483671 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a346ab5e-ad2d-4b7b-bc9f-83bd82f10d71 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:57.484688 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a346ab5e-ad2d-4b7b-bc9f-83bd82f10d71 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:57.485342 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a346ab5e-ad2d-4b7b-bc9f-83bd82f10d71 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:57.486047 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a346ab5e-ad2d-4b7b-bc9f-83bd82f10d71 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:57.698341 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-223478ba-75fe-4889-813d-0be2670d7014 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:57.702272 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-223478ba-75fe-4889-813d-0be2670d7014 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:57.714474 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-223478ba-75fe-4889-813d-0be2670d7014 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:57.715273 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-223478ba-75fe-4889-813d-0be2670d7014 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:57.716138 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-223478ba-75fe-4889-813d-0be2670d7014 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:57.719687 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-223478ba-75fe-4889-813d-0be2670d7014 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:57.720572 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-223478ba-75fe-4889-813d-0be2670d7014 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:57.721639 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-223478ba-75fe-4889-813d-0be2670d7014 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:57.858783 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-a346ab5e-ad2d-4b7b-bc9f-83bd82f10d71 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:57.867889 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-a346ab5e-ad2d-4b7b-bc9f-83bd82f10d71 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:57.869347 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-a346ab5e-ad2d-4b7b-bc9f-83bd82f10d71 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:57.875068 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-a346ab5e-ad2d-4b7b-bc9f-83bd82f10d71 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1408 microversion: 2.20 time: 0.411475 Sep 16 01:54:57.886661 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 108/207] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:54:57 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1408 bytes in 415 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:54:57.929750 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-223478ba-75fe-4889-813d-0be2670d7014 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:57.939478 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-223478ba-75fe-4889-813d-0be2670d7014 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1321 microversion: 2.1 time: 0.249825 Sep 16 01:54:57.940714 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 100/208] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:57 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1321 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:58.314239 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-ed02d7d0-def1-4637-95e8-217889620569 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:58.315079 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-ed02d7d0-def1-4637-95e8-217889620569 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:58.322477 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ed02d7d0-def1-4637-95e8-217889620569 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:58.323053 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ed02d7d0-def1-4637-95e8-217889620569 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:58.323679 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ed02d7d0-def1-4637-95e8-217889620569 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:58.325087 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ed02d7d0-def1-4637-95e8-217889620569 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:58.325684 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ed02d7d0-def1-4637-95e8-217889620569 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:58.326349 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ed02d7d0-def1-4637-95e8-217889620569 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:58.477602 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-ed02d7d0-def1-4637-95e8-217889620569 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:58.496183 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-ed02d7d0-def1-4637-95e8-217889620569 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1364 microversion: 2.1 time: 0.186204 Sep 16 01:54:58.499176 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 109/209] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:58 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1364 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:58.902871 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-92e70682-b3a9-4840-a070-b22e3280c354 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:58.904358 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-92e70682-b3a9-4840-a070-b22e3280c354 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:58.913008 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-92e70682-b3a9-4840-a070-b22e3280c354 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:58.928883 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-92e70682-b3a9-4840-a070-b22e3280c354 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:58.929367 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-92e70682-b3a9-4840-a070-b22e3280c354 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:58.930112 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-92e70682-b3a9-4840-a070-b22e3280c354 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:58.930558 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-92e70682-b3a9-4840-a070-b22e3280c354 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:58.930971 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-92e70682-b3a9-4840-a070-b22e3280c354 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:58.968837 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-940d220d-9492-4ba2-84ce-4a6479302e78 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:58.970368 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-940d220d-9492-4ba2-84ce-4a6479302e78 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:58.979973 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-940d220d-9492-4ba2-84ce-4a6479302e78 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:58.981090 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-940d220d-9492-4ba2-84ce-4a6479302e78 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:58.982496 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-940d220d-9492-4ba2-84ce-4a6479302e78 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:58.983393 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-940d220d-9492-4ba2-84ce-4a6479302e78 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:58.984029 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-940d220d-9492-4ba2-84ce-4a6479302e78 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:58.984608 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-940d220d-9492-4ba2-84ce-4a6479302e78 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:59.121778 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-92e70682-b3a9-4840-a070-b22e3280c354 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:59.142381 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-92e70682-b3a9-4840-a070-b22e3280c354 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:59.144798 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-92e70682-b3a9-4840-a070-b22e3280c354 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:59.146770 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-92e70682-b3a9-4840-a070-b22e3280c354 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1408 microversion: 2.20 time: 0.248333 Sep 16 01:54:59.148096 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 101/210] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:54:58 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1408 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:54:59.228219 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-940d220d-9492-4ba2-84ce-4a6479302e78 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:59.278257 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-940d220d-9492-4ba2-84ce-4a6479302e78 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1321 microversion: 2.1 time: 0.314318 Sep 16 01:54:59.278845 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 110/211] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:58 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1321 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:54:59.538419 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-8ad3561f-d43b-416b-961f-c993007e6114 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:54:59.539458 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-8ad3561f-d43b-416b-961f-c993007e6114 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:54:59.562901 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8ad3561f-d43b-416b-961f-c993007e6114 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:59.564381 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8ad3561f-d43b-416b-961f-c993007e6114 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:59.565520 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8ad3561f-d43b-416b-961f-c993007e6114 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:59.566784 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8ad3561f-d43b-416b-961f-c993007e6114 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:54:59.568401 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8ad3561f-d43b-416b-961f-c993007e6114 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:54:59.570175 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8ad3561f-d43b-416b-961f-c993007e6114 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:54:59.741092 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-8ad3561f-d43b-416b-961f-c993007e6114 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:54:59.750907 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-8ad3561f-d43b-416b-961f-c993007e6114 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1364 microversion: 2.1 time: 0.222857 Sep 16 01:54:59.751588 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 102/212] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:54:59 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1364 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:00.177045 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-e4a0a318-bcf4-4b33-92ae-c8e07513779e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:00.178092 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-e4a0a318-bcf4-4b33-92ae-c8e07513779e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:00.186413 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e4a0a318-bcf4-4b33-92ae-c8e07513779e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:00.187374 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e4a0a318-bcf4-4b33-92ae-c8e07513779e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:00.188107 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e4a0a318-bcf4-4b33-92ae-c8e07513779e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:00.189023 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e4a0a318-bcf4-4b33-92ae-c8e07513779e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:00.189651 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e4a0a318-bcf4-4b33-92ae-c8e07513779e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:00.190790 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e4a0a318-bcf4-4b33-92ae-c8e07513779e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:00.304259 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-99ecce45-37dd-4ca6-ae00-692d24d179b0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:00.305497 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-99ecce45-37dd-4ca6-ae00-692d24d179b0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:00.312847 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-99ecce45-37dd-4ca6-ae00-692d24d179b0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:00.313718 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-99ecce45-37dd-4ca6-ae00-692d24d179b0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:00.314387 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-99ecce45-37dd-4ca6-ae00-692d24d179b0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:00.315332 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-99ecce45-37dd-4ca6-ae00-692d24d179b0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:00.316216 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-99ecce45-37dd-4ca6-ae00-692d24d179b0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:00.317103 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-99ecce45-37dd-4ca6-ae00-692d24d179b0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:00.387081 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-e4a0a318-bcf4-4b33-92ae-c8e07513779e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:00.406136 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-e4a0a318-bcf4-4b33-92ae-c8e07513779e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:00.408682 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-e4a0a318-bcf4-4b33-92ae-c8e07513779e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:00.410032 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-e4a0a318-bcf4-4b33-92ae-c8e07513779e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1408 microversion: 2.20 time: 0.239780 Sep 16 01:55:00.410894 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 111/213] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:55:00 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1408 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:55:00.591985 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-99ecce45-37dd-4ca6-ae00-692d24d179b0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:00.600774 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-99ecce45-37dd-4ca6-ae00-692d24d179b0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1321 microversion: 2.1 time: 0.301631 Sep 16 01:55:00.616411 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 103/214] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:00 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1321 bytes in 318 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 01:55:00.775521 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-082402fc-56e5-497d-81d8-79e30589d516 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:00.776318 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-082402fc-56e5-497d-81d8-79e30589d516 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:00.782837 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-082402fc-56e5-497d-81d8-79e30589d516 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:00.783387 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-082402fc-56e5-497d-81d8-79e30589d516 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:00.784095 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-082402fc-56e5-497d-81d8-79e30589d516 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:00.784863 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-082402fc-56e5-497d-81d8-79e30589d516 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:00.785640 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-082402fc-56e5-497d-81d8-79e30589d516 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:00.786070 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-082402fc-56e5-497d-81d8-79e30589d516 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:00.928347 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-082402fc-56e5-497d-81d8-79e30589d516 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:00.936498 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-082402fc-56e5-497d-81d8-79e30589d516 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1364 microversion: 2.1 time: 0.165425 Sep 16 01:55:00.937070 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 112/215] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:00 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:01.438582 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-2afca328-cf3e-47d1-be83-6301aaf2d692 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:01.440450 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-2afca328-cf3e-47d1-be83-6301aaf2d692 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:01.455287 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2afca328-cf3e-47d1-be83-6301aaf2d692 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:01.456564 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2afca328-cf3e-47d1-be83-6301aaf2d692 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:01.457301 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2afca328-cf3e-47d1-be83-6301aaf2d692 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:01.459875 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2afca328-cf3e-47d1-be83-6301aaf2d692 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:01.464200 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2afca328-cf3e-47d1-be83-6301aaf2d692 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:01.464916 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2afca328-cf3e-47d1-be83-6301aaf2d692 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:01.625755 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-f942da94-277f-422c-91c2-dfaafc9998b5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:01.627285 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-f942da94-277f-422c-91c2-dfaafc9998b5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:01.645534 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f942da94-277f-422c-91c2-dfaafc9998b5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:01.648209 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f942da94-277f-422c-91c2-dfaafc9998b5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:01.648658 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f942da94-277f-422c-91c2-dfaafc9998b5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:01.650397 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f942da94-277f-422c-91c2-dfaafc9998b5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:01.654306 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f942da94-277f-422c-91c2-dfaafc9998b5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:01.655195 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f942da94-277f-422c-91c2-dfaafc9998b5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:01.740094 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-2afca328-cf3e-47d1-be83-6301aaf2d692 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:01.750906 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-2afca328-cf3e-47d1-be83-6301aaf2d692 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:01.753630 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-2afca328-cf3e-47d1-be83-6301aaf2d692 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:01.757464 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-2afca328-cf3e-47d1-be83-6301aaf2d692 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1408 microversion: 2.20 time: 0.324523 Sep 16 01:55:01.758842 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 104/216] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:55:01 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1408 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:55:01.859669 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-c262cd71-ddc8-4dc2-9208-262e2fa3ba13 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e86bf1c8-6733-47d5-9e04-c2648ba29e86"}} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:55:01.877023 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-c262cd71-ddc8-4dc2-9208-262e2fa3ba13 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] [instance: 33b0ab06-b40e-4c13-a33f-cd6a2881fd16] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:01.902078 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c262cd71-ddc8-4dc2-9208-262e2fa3ba13 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:01.902617 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c262cd71-ddc8-4dc2-9208-262e2fa3ba13 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:01.903059 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c262cd71-ddc8-4dc2-9208-262e2fa3ba13 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:01.908743 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c262cd71-ddc8-4dc2-9208-262e2fa3ba13 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:01.909272 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c262cd71-ddc8-4dc2-9208-262e2fa3ba13 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:01.911436 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c262cd71-ddc8-4dc2-9208-262e2fa3ba13 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:02.224788 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-f942da94-277f-422c-91c2-dfaafc9998b5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:02.238123 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-f942da94-277f-422c-91c2-dfaafc9998b5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1321 microversion: 2.1 time: 0.615380 Sep 16 01:55:02.244458 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 113/217] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:01 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1321 bytes in 624 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:02.251076 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-ec496484-81e4-4755-915e-17740e75c19b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:02.252115 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-ec496484-81e4-4755-915e-17740e75c19b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:02.261975 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ec496484-81e4-4755-915e-17740e75c19b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:02.262887 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ec496484-81e4-4755-915e-17740e75c19b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:02.263774 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ec496484-81e4-4755-915e-17740e75c19b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:02.265652 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ec496484-81e4-4755-915e-17740e75c19b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:02.273546 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ec496484-81e4-4755-915e-17740e75c19b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:02.275519 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ec496484-81e4-4755-915e-17740e75c19b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:02.501055 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-ec496484-81e4-4755-915e-17740e75c19b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:02.509384 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-ec496484-81e4-4755-915e-17740e75c19b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1364 microversion: 2.1 time: 0.262886 Sep 16 01:55:02.510219 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 114/218] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:02 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1364 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:02.594882 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [req-aa5fa008-70f5-4447-b734-4712a2aef538 req-380be2b6-cbce-4371-8285-2697e4f380dd service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7", "name": "network-vif-plugged", "status": "completed", "tag": "f93c0228-6dda-49f9-ac21-d2d3362262fa"}]} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:55:02.612629 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-aa5fa008-70f5-4447-b734-4712a2aef538 req-380be2b6-cbce-4371-8285-2697e4f380dd service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:02.618918 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-aa5fa008-70f5-4447-b734-4712a2aef538 req-380be2b6-cbce-4371-8285-2697e4f380dd service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:02.622187 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-aa5fa008-70f5-4447-b734-4712a2aef538 req-380be2b6-cbce-4371-8285-2697e4f380dd service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:02.648709 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.compute.server_external_events [req-aa5fa008-70f5-4447-b734-4712a2aef538 req-380be2b6-cbce-4371-8285-2697e4f380dd service nova] Creating event network-vif-plugged:f93c0228-6dda-49f9-ac21-d2d3362262fa for instance 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 on hv-cinder-84914 Sep 16 01:55:02.655515 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [req-aa5fa008-70f5-4447-b734-4712a2aef538 req-380be2b6-cbce-4371-8285-2697e4f380dd service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.064625 Sep 16 01:55:02.657160 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 115/219] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 01:55:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 01:55:02.800411 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-1467e311-5abe-4688-bb87-b9dea831da51 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:02.803487 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-1467e311-5abe-4688-bb87-b9dea831da51 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:02.827502 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1467e311-5abe-4688-bb87-b9dea831da51 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:02.829346 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1467e311-5abe-4688-bb87-b9dea831da51 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:02.830062 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1467e311-5abe-4688-bb87-b9dea831da51 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:02.831118 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1467e311-5abe-4688-bb87-b9dea831da51 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:02.840003 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1467e311-5abe-4688-bb87-b9dea831da51 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:02.841035 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1467e311-5abe-4688-bb87-b9dea831da51 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:03.222521 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-1467e311-5abe-4688-bb87-b9dea831da51 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:03.242050 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-1467e311-5abe-4688-bb87-b9dea831da51 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:03.244477 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-1467e311-5abe-4688-bb87-b9dea831da51 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:03.246241 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-1467e311-5abe-4688-bb87-b9dea831da51 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1600 microversion: 2.20 time: 0.458212 Sep 16 01:55:03.284157 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 116/220] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:55:02 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1600 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:55:03.290393 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-19daa958-7217-41fe-97bf-cfdb47107e4c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:03.291019 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-19daa958-7217-41fe-97bf-cfdb47107e4c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:03.298034 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-19daa958-7217-41fe-97bf-cfdb47107e4c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:03.298564 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-19daa958-7217-41fe-97bf-cfdb47107e4c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:03.299060 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-19daa958-7217-41fe-97bf-cfdb47107e4c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:03.299916 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-19daa958-7217-41fe-97bf-cfdb47107e4c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:03.300755 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-19daa958-7217-41fe-97bf-cfdb47107e4c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:03.301770 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-19daa958-7217-41fe-97bf-cfdb47107e4c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:03.534678 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-19daa958-7217-41fe-97bf-cfdb47107e4c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:03.543302 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-19daa958-7217-41fe-97bf-cfdb47107e4c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1321 microversion: 2.1 time: 0.257850 Sep 16 01:55:03.544263 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 117/221] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:03 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1321 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:03.549430 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-92a2d4b3-3d19-448f-b3be-edc22a95679a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:03.550173 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-92a2d4b3-3d19-448f-b3be-edc22a95679a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:03.557059 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-92a2d4b3-3d19-448f-b3be-edc22a95679a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:03.557815 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-92a2d4b3-3d19-448f-b3be-edc22a95679a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:03.558483 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-92a2d4b3-3d19-448f-b3be-edc22a95679a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:03.559553 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-92a2d4b3-3d19-448f-b3be-edc22a95679a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:03.560245 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-92a2d4b3-3d19-448f-b3be-edc22a95679a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:03.560879 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-92a2d4b3-3d19-448f-b3be-edc22a95679a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:03.692282 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-92a2d4b3-3d19-448f-b3be-edc22a95679a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.146209 Sep 16 01:55:03.692865 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 118/222] 10.222.0.42 () {60 vars in 1316 bytes} [Fri Sep 16 01:55:03 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6/os-interface => generated 284 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 01:55:03.697852 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-8c0638bc-b3bb-4ec2-9fe0-10ef3b00e420 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:03.698631 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-8c0638bc-b3bb-4ec2-9fe0-10ef3b00e420 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:03.704858 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8c0638bc-b3bb-4ec2-9fe0-10ef3b00e420 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:03.705340 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8c0638bc-b3bb-4ec2-9fe0-10ef3b00e420 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:03.705768 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8c0638bc-b3bb-4ec2-9fe0-10ef3b00e420 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:03.706449 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8c0638bc-b3bb-4ec2-9fe0-10ef3b00e420 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:03.706908 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8c0638bc-b3bb-4ec2-9fe0-10ef3b00e420 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:03.707965 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8c0638bc-b3bb-4ec2-9fe0-10ef3b00e420 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:04.036649 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-8c0638bc-b3bb-4ec2-9fe0-10ef3b00e420 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:04.040446 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell1:SELECT=100 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:55:04.046006 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-8c0638bc-b3bb-4ec2-9fe0-10ef3b00e420 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1364 microversion: 2.1 time: 0.351936 Sep 16 01:55:04.046580 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 119/223] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:03 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1364 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:04.344565 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-c262cd71-ddc8-4dc2-9208-262e2fa3ba13 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] 10.222.0.42 "POST /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.489216 Sep 16 01:55:04.345990 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 105/224] 10.222.0.42 () {60 vars in 1323 bytes} [Fri Sep 16 01:55:01 2022] POST /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16/os-volume_attachments => generated 194 bytes in 2492 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 01:55:04.570188 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-8b8215f5-e5e9-4af5-b989-6c2c2e2670a6 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:04.571003 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-8b8215f5-e5e9-4af5-b989-6c2c2e2670a6 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:04.577478 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8b8215f5-e5e9-4af5-b989-6c2c2e2670a6 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:04.578306 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8b8215f5-e5e9-4af5-b989-6c2c2e2670a6 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:04.579047 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8b8215f5-e5e9-4af5-b989-6c2c2e2670a6 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:04.580034 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8b8215f5-e5e9-4af5-b989-6c2c2e2670a6 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:04.580565 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8b8215f5-e5e9-4af5-b989-6c2c2e2670a6 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:04.581058 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8b8215f5-e5e9-4af5-b989-6c2c2e2670a6 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:05.075184 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-8800ffb9-a78d-4b9d-8195-fce85c848406 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:05.075486 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-8b8215f5-e5e9-4af5-b989-6c2c2e2670a6 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:05.076143 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-8800ffb9-a78d-4b9d-8195-fce85c848406 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:05.085213 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8800ffb9-a78d-4b9d-8195-fce85c848406 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:05.085834 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8800ffb9-a78d-4b9d-8195-fce85c848406 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:05.086305 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8800ffb9-a78d-4b9d-8195-fce85c848406 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:05.087013 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8800ffb9-a78d-4b9d-8195-fce85c848406 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:05.087461 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8800ffb9-a78d-4b9d-8195-fce85c848406 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:05.087871 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8800ffb9-a78d-4b9d-8195-fce85c848406 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:05.092554 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-8b8215f5-e5e9-4af5-b989-6c2c2e2670a6 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1321 microversion: 2.1 time: 0.526895 Sep 16 01:55:05.095054 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 120/225] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:04 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1321 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:05.234882 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-8800ffb9-a78d-4b9d-8195-fce85c848406 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:05.243760 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-8800ffb9-a78d-4b9d-8195-fce85c848406 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1364 microversion: 2.1 time: 0.177136 Sep 16 01:55:05.244392 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 106/226] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:05 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1364 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:05.439648 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [req-b3512fc4-3a25-444d-a962-cbe2443f9ac2 req-bed378a0-efb1-4742-ae68-fef708aef5bc service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3e390b45-0b39-4429-9431-7ee6af3806e6", "tag": "dc91b77b-583a-4740-a244-adc53daa4347"}]} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:55:05.451395 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-b3512fc4-3a25-444d-a962-cbe2443f9ac2 req-bed378a0-efb1-4742-ae68-fef708aef5bc service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:05.451900 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-b3512fc4-3a25-444d-a962-cbe2443f9ac2 req-bed378a0-efb1-4742-ae68-fef708aef5bc service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:05.452559 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-b3512fc4-3a25-444d-a962-cbe2443f9ac2 req-bed378a0-efb1-4742-ae68-fef708aef5bc service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:05.467475 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.compute.server_external_events [req-b3512fc4-3a25-444d-a962-cbe2443f9ac2 req-bed378a0-efb1-4742-ae68-fef708aef5bc service nova] Creating event network-changed:dc91b77b-583a-4740-a244-adc53daa4347 for instance 3e390b45-0b39-4429-9431-7ee6af3806e6 on hv-cinder-84914 Sep 16 01:55:05.486937 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [req-b3512fc4-3a25-444d-a962-cbe2443f9ac2 req-bed378a0-efb1-4742-ae68-fef708aef5bc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050525 Sep 16 01:55:05.488364 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 121/227] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 01:55:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:55:06.117685 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-9e6125ff-a208-42d5-a820-b5531b970ff0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:06.120980 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-9e6125ff-a208-42d5-a820-b5531b970ff0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:06.140584 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9e6125ff-a208-42d5-a820-b5531b970ff0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:06.141336 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9e6125ff-a208-42d5-a820-b5531b970ff0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:06.142414 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9e6125ff-a208-42d5-a820-b5531b970ff0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:06.143550 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9e6125ff-a208-42d5-a820-b5531b970ff0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:06.144391 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9e6125ff-a208-42d5-a820-b5531b970ff0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:06.145317 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9e6125ff-a208-42d5-a820-b5531b970ff0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:06.277468 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-15f2c3a3-536d-46c3-943d-6c8266556adf tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:06.279392 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-15f2c3a3-536d-46c3-943d-6c8266556adf tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:06.294925 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-15f2c3a3-536d-46c3-943d-6c8266556adf tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:06.295420 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-15f2c3a3-536d-46c3-943d-6c8266556adf tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:06.295889 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-15f2c3a3-536d-46c3-943d-6c8266556adf tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:06.298238 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-15f2c3a3-536d-46c3-943d-6c8266556adf tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:06.298700 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-15f2c3a3-536d-46c3-943d-6c8266556adf tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:06.299129 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-15f2c3a3-536d-46c3-943d-6c8266556adf tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:06.342384 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-9e6125ff-a208-42d5-a820-b5531b970ff0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:06.353393 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-9e6125ff-a208-42d5-a820-b5531b970ff0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1321 microversion: 2.1 time: 0.241210 Sep 16 01:55:06.369157 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 107/228] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:06 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1321 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:06.565939 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-15f2c3a3-536d-46c3-943d-6c8266556adf tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:06.575919 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-15f2c3a3-536d-46c3-943d-6c8266556adf tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1549 microversion: 2.1 time: 0.306452 Sep 16 01:55:06.576320 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 122/229] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:06 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1549 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 01:55:06.602952 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-0e84fcb9-29fd-465e-a041-346ad56e0824 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:06.605481 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-0e84fcb9-29fd-465e-a041-346ad56e0824 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:06.612788 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0e84fcb9-29fd-465e-a041-346ad56e0824 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:06.616507 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0e84fcb9-29fd-465e-a041-346ad56e0824 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:06.616977 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0e84fcb9-29fd-465e-a041-346ad56e0824 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:06.617852 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0e84fcb9-29fd-465e-a041-346ad56e0824 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:06.618326 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0e84fcb9-29fd-465e-a041-346ad56e0824 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:06.618756 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0e84fcb9-29fd-465e-a041-346ad56e0824 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:06.760552 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-0e84fcb9-29fd-465e-a041-346ad56e0824 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.158977 Sep 16 01:55:06.780649 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 108/230] 10.222.0.42 () {58 vars in 1275 bytes} [Fri Sep 16 01:55:06 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763/os-interface => generated 284 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:55:07.379811 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-9b2fd0ed-352b-4354-b033-dbf31941083c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:07.381940 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-9b2fd0ed-352b-4354-b033-dbf31941083c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:07.393156 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9b2fd0ed-352b-4354-b033-dbf31941083c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:07.394410 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9b2fd0ed-352b-4354-b033-dbf31941083c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:07.395701 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9b2fd0ed-352b-4354-b033-dbf31941083c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:07.396679 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9b2fd0ed-352b-4354-b033-dbf31941083c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:07.397367 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9b2fd0ed-352b-4354-b033-dbf31941083c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:07.398054 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9b2fd0ed-352b-4354-b033-dbf31941083c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:07.866355 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-9b2fd0ed-352b-4354-b033-dbf31941083c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:07.880905 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-9b2fd0ed-352b-4354-b033-dbf31941083c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1321 microversion: 2.1 time: 0.506622 Sep 16 01:55:07.892858 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 123/231] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:07 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1321 bytes in 519 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:08.463896 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [req-2c915cdb-cec2-490f-97bd-8096f4182a83 req-f4b97b10-3954-49dd-aadd-e5d38d548dec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "df8bdee8-15d2-4b18-a2d0-8b24b43f6763", "tag": "32e8d554-2d45-428d-8c7c-03347e83c61a"}]} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:55:08.482384 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-2c915cdb-cec2-490f-97bd-8096f4182a83 req-f4b97b10-3954-49dd-aadd-e5d38d548dec service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:08.482843 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-2c915cdb-cec2-490f-97bd-8096f4182a83 req-f4b97b10-3954-49dd-aadd-e5d38d548dec service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:08.483607 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-2c915cdb-cec2-490f-97bd-8096f4182a83 req-f4b97b10-3954-49dd-aadd-e5d38d548dec service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:08.490458 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:55:08.499928 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.compute.server_external_events [req-2c915cdb-cec2-490f-97bd-8096f4182a83 req-f4b97b10-3954-49dd-aadd-e5d38d548dec service nova] Creating event network-changed:32e8d554-2d45-428d-8c7c-03347e83c61a for instance df8bdee8-15d2-4b18-a2d0-8b24b43f6763 on hv-cinder-84914 Sep 16 01:55:08.508031 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [req-2c915cdb-cec2-490f-97bd-8096f4182a83 req-f4b97b10-3954-49dd-aadd-e5d38d548dec service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054673 Sep 16 01:55:08.508873 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 109/232] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 01:55:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:55:08.905296 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-7aca777f-eb3a-4bc8-bdc2-ab64dea2c93e tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:08.906531 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-7aca777f-eb3a-4bc8-bdc2-ab64dea2c93e tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:08.914482 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7aca777f-eb3a-4bc8-bdc2-ab64dea2c93e tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:08.915151 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7aca777f-eb3a-4bc8-bdc2-ab64dea2c93e tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:08.915579 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7aca777f-eb3a-4bc8-bdc2-ab64dea2c93e tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:08.916290 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7aca777f-eb3a-4bc8-bdc2-ab64dea2c93e tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:08.916895 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7aca777f-eb3a-4bc8-bdc2-ab64dea2c93e tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:08.917308 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7aca777f-eb3a-4bc8-bdc2-ab64dea2c93e tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:09.068241 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-7aca777f-eb3a-4bc8-bdc2-ab64dea2c93e tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:09.081774 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-7aca777f-eb3a-4bc8-bdc2-ab64dea2c93e tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1514 microversion: 2.1 time: 0.180418 Sep 16 01:55:09.083957 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 124/233] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:08 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1514 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 01:55:09.111868 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-ac83e795-ae38-4b14-8a50-238a065b63fc tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:55:09.115637 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-ac83e795-ae38-4b14-8a50-238a065b63fc tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:09.131841 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ac83e795-ae38-4b14-8a50-238a065b63fc tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:09.132364 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ac83e795-ae38-4b14-8a50-238a065b63fc tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:09.132793 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ac83e795-ae38-4b14-8a50-238a065b63fc tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:09.136677 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ac83e795-ae38-4b14-8a50-238a065b63fc tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:09.138780 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ac83e795-ae38-4b14-8a50-238a065b63fc tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:09.139233 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ac83e795-ae38-4b14-8a50-238a065b63fc tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:09.196465 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.objects.instance [None req-ac83e795-ae38-4b14-8a50-238a065b63fc tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lazy-loading 'flavor' on Instance uuid 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 {{(pid=120440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 01:55:09.395894 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-ac83e795-ae38-4b14-8a50-238a065b63fc tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "POST /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7/action" status: 200 len: 32 microversion: 2.1 time: 0.291586 Sep 16 01:55:09.407275 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-6e8567c8-b696-4006-9c6d-4f9549d19b97 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:09.408482 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-6e8567c8-b696-4006-9c6d-4f9549d19b97 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:09.412361 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 110/234] 10.222.0.42 () {60 vars in 1278 bytes} [Fri Sep 16 01:55:09 2022] POST /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7/action => generated 32 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 16 01:55:09.420072 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-6e8567c8-b696-4006-9c6d-4f9549d19b97 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:09.420906 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-6e8567c8-b696-4006-9c6d-4f9549d19b97 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:09.422055 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-6e8567c8-b696-4006-9c6d-4f9549d19b97 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:09.432636 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-6e8567c8-b696-4006-9c6d-4f9549d19b97 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:09.433957 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-6e8567c8-b696-4006-9c6d-4f9549d19b97 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:09.435058 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-6e8567c8-b696-4006-9c6d-4f9549d19b97 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:09.903780 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-6e8567c8-b696-4006-9c6d-4f9549d19b97 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:09.912237 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-6e8567c8-b696-4006-9c6d-4f9549d19b97 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1520 microversion: 2.1 time: 0.509727 Sep 16 01:55:09.924688 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 125/235] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:09 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1520 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:10.937062 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-3d8a2b4e-73ef-4838-951e-27dc5ec161d4 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:10.937756 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-3d8a2b4e-73ef-4838-951e-27dc5ec161d4 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:10.950827 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3d8a2b4e-73ef-4838-951e-27dc5ec161d4 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:10.951534 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3d8a2b4e-73ef-4838-951e-27dc5ec161d4 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:10.952158 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3d8a2b4e-73ef-4838-951e-27dc5ec161d4 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:10.953992 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3d8a2b4e-73ef-4838-951e-27dc5ec161d4 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:10.955623 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3d8a2b4e-73ef-4838-951e-27dc5ec161d4 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:10.956249 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3d8a2b4e-73ef-4838-951e-27dc5ec161d4 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:11.119888 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-3d8a2b4e-73ef-4838-951e-27dc5ec161d4 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:11.131378 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-3d8a2b4e-73ef-4838-951e-27dc5ec161d4 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1520 microversion: 2.1 time: 0.198330 Sep 16 01:55:11.132191 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 111/236] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:10 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1520 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:12.154607 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-d54fd5eb-2f16-40a2-8af9-a71663732603 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:12.155211 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-d54fd5eb-2f16-40a2-8af9-a71663732603 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:12.161255 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d54fd5eb-2f16-40a2-8af9-a71663732603 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:12.161734 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d54fd5eb-2f16-40a2-8af9-a71663732603 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:12.162177 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d54fd5eb-2f16-40a2-8af9-a71663732603 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:12.162846 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d54fd5eb-2f16-40a2-8af9-a71663732603 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:12.163294 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d54fd5eb-2f16-40a2-8af9-a71663732603 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:12.163713 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d54fd5eb-2f16-40a2-8af9-a71663732603 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:12.296956 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-d54fd5eb-2f16-40a2-8af9-a71663732603 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:12.305665 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-d54fd5eb-2f16-40a2-8af9-a71663732603 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1520 microversion: 2.1 time: 0.154883 Sep 16 01:55:12.306236 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 126/237] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:12 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:13.328372 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-0cb8e1b7-11d6-4d4a-a455-ec65efe48c93 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:13.328987 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-0cb8e1b7-11d6-4d4a-a455-ec65efe48c93 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:13.335882 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0cb8e1b7-11d6-4d4a-a455-ec65efe48c93 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:13.336392 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0cb8e1b7-11d6-4d4a-a455-ec65efe48c93 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:13.337187 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0cb8e1b7-11d6-4d4a-a455-ec65efe48c93 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:13.337870 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0cb8e1b7-11d6-4d4a-a455-ec65efe48c93 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:13.338246 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0cb8e1b7-11d6-4d4a-a455-ec65efe48c93 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:13.338670 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0cb8e1b7-11d6-4d4a-a455-ec65efe48c93 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:13.475725 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-0cb8e1b7-11d6-4d4a-a455-ec65efe48c93 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:13.487382 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-0cb8e1b7-11d6-4d4a-a455-ec65efe48c93 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1520 microversion: 2.1 time: 0.162468 Sep 16 01:55:13.488008 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 112/238] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:13 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:14.511137 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-dfe89d38-8dd1-4755-a983-f4b65ce0f498 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:14.511748 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-dfe89d38-8dd1-4755-a983-f4b65ce0f498 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:14.518476 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-dfe89d38-8dd1-4755-a983-f4b65ce0f498 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:14.521652 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-dfe89d38-8dd1-4755-a983-f4b65ce0f498 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:14.521652 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-dfe89d38-8dd1-4755-a983-f4b65ce0f498 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:14.521652 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-dfe89d38-8dd1-4755-a983-f4b65ce0f498 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:14.521932 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-dfe89d38-8dd1-4755-a983-f4b65ce0f498 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:14.522327 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-dfe89d38-8dd1-4755-a983-f4b65ce0f498 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:14.665593 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-dfe89d38-8dd1-4755-a983-f4b65ce0f498 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:14.673967 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-dfe89d38-8dd1-4755-a983-f4b65ce0f498 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1520 microversion: 2.1 time: 0.166460 Sep 16 01:55:14.674498 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 127/239] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:14 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1520 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:15.698508 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-cd463cd8-2b44-4eac-91f5-0307e8e6d3a4 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:15.699892 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-cd463cd8-2b44-4eac-91f5-0307e8e6d3a4 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:15.707983 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cd463cd8-2b44-4eac-91f5-0307e8e6d3a4 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:15.708464 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cd463cd8-2b44-4eac-91f5-0307e8e6d3a4 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:15.709166 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cd463cd8-2b44-4eac-91f5-0307e8e6d3a4 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:15.710308 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cd463cd8-2b44-4eac-91f5-0307e8e6d3a4 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:15.710781 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cd463cd8-2b44-4eac-91f5-0307e8e6d3a4 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:15.711195 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cd463cd8-2b44-4eac-91f5-0307e8e6d3a4 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:15.865464 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-cd463cd8-2b44-4eac-91f5-0307e8e6d3a4 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:15.872999 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-cd463cd8-2b44-4eac-91f5-0307e8e6d3a4 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1520 microversion: 2.1 time: 0.179221 Sep 16 01:55:15.873565 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 113/240] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:15 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1520 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:16.898727 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-1efbabbd-f4b4-443a-adab-45aa017b5c7e tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:16.900697 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-1efbabbd-f4b4-443a-adab-45aa017b5c7e tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:16.908490 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1efbabbd-f4b4-443a-adab-45aa017b5c7e tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:16.909490 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1efbabbd-f4b4-443a-adab-45aa017b5c7e tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:16.910461 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1efbabbd-f4b4-443a-adab-45aa017b5c7e tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:16.911320 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1efbabbd-f4b4-443a-adab-45aa017b5c7e tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:16.911809 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1efbabbd-f4b4-443a-adab-45aa017b5c7e tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:16.912262 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1efbabbd-f4b4-443a-adab-45aa017b5c7e tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:17.119451 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-1efbabbd-f4b4-443a-adab-45aa017b5c7e tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:17.128719 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-1efbabbd-f4b4-443a-adab-45aa017b5c7e tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1520 microversion: 2.1 time: 0.234174 Sep 16 01:55:17.129436 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 128/241] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:16 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1520 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:17.860765 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-60f53a84-c6db-4df3-bcb7-bbbb13e6fff7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:17.861291 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-60f53a84-c6db-4df3-bcb7-bbbb13e6fff7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] [instance: 33b0ab06-b40e-4c13-a33f-cd6a2881fd16] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:17.867762 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-60f53a84-c6db-4df3-bcb7-bbbb13e6fff7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:17.868277 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-60f53a84-c6db-4df3-bcb7-bbbb13e6fff7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:17.868717 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-60f53a84-c6db-4df3-bcb7-bbbb13e6fff7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:17.869407 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-60f53a84-c6db-4df3-bcb7-bbbb13e6fff7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:17.869858 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-60f53a84-c6db-4df3-bcb7-bbbb13e6fff7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:17.870319 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-60f53a84-c6db-4df3-bcb7-bbbb13e6fff7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:17.898198 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-60f53a84-c6db-4df3-bcb7-bbbb13e6fff7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] [instance: 33b0ab06-b40e-4c13-a33f-cd6a2881fd16] Going to try to terminate instance {{(pid=120440) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 01:55:18.009202 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-60f53a84-c6db-4df3-bcb7-bbbb13e6fff7 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] 10.222.0.42 "DELETE /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16" status: 204 len: 0 microversion: 2.1 time: 0.151888 Sep 16 01:55:18.010049 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 114/242] 10.222.0.42 () {58 vars in 1239 bytes} [Fri Sep 16 01:55:17 2022] DELETE /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16 => generated 0 bytes in 154 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 01:55:18.019895 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-c97ec295-d86c-41cf-84d1-11c8d1b8ef48 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:18.020824 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-c97ec295-d86c-41cf-84d1-11c8d1b8ef48 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] [instance: 33b0ab06-b40e-4c13-a33f-cd6a2881fd16] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:18.023916 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_api:SELECT=74 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:55:18.030527 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c97ec295-d86c-41cf-84d1-11c8d1b8ef48 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:18.031248 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c97ec295-d86c-41cf-84d1-11c8d1b8ef48 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:18.031860 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c97ec295-d86c-41cf-84d1-11c8d1b8ef48 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:18.032676 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c97ec295-d86c-41cf-84d1-11c8d1b8ef48 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:18.033524 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c97ec295-d86c-41cf-84d1-11c8d1b8ef48 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:18.034166 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c97ec295-d86c-41cf-84d1-11c8d1b8ef48 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:18.155085 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-ab19c92c-de65-497c-9310-6f5922d41be9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:18.156659 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-ab19c92c-de65-497c-9310-6f5922d41be9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:18.168352 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ab19c92c-de65-497c-9310-6f5922d41be9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:18.169408 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ab19c92c-de65-497c-9310-6f5922d41be9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:18.170076 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ab19c92c-de65-497c-9310-6f5922d41be9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:18.171618 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ab19c92c-de65-497c-9310-6f5922d41be9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:18.172454 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ab19c92c-de65-497c-9310-6f5922d41be9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:18.173185 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ab19c92c-de65-497c-9310-6f5922d41be9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:18.260150 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-c97ec295-d86c-41cf-84d1-11c8d1b8ef48 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a39440ed016445a7bfc7ac7fba6661f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477dd0575c8741b0815ddf5f22297db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:18.274056 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-c97ec295-d86c-41cf-84d1-11c8d1b8ef48 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] 10.222.0.42 "GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16" status: 200 len: 1553 microversion: 2.1 time: 0.258661 Sep 16 01:55:18.275832 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 129/243] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:18 2022] GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16 => generated 1553 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 01:55:18.399240 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-ab19c92c-de65-497c-9310-6f5922d41be9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:18.412196 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-ab19c92c-de65-497c-9310-6f5922d41be9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1520 microversion: 2.1 time: 0.261969 Sep 16 01:55:18.414004 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 115/244] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:18 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1520 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:19.307475 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-af1f9b2e-4c38-4164-9e08-9b55320e893f tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:19.308138 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-af1f9b2e-4c38-4164-9e08-9b55320e893f tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] [instance: 33b0ab06-b40e-4c13-a33f-cd6a2881fd16] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:19.314410 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-af1f9b2e-4c38-4164-9e08-9b55320e893f tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:19.315168 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-af1f9b2e-4c38-4164-9e08-9b55320e893f tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:19.315861 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-af1f9b2e-4c38-4164-9e08-9b55320e893f tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:19.316822 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-af1f9b2e-4c38-4164-9e08-9b55320e893f tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:19.317562 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-af1f9b2e-4c38-4164-9e08-9b55320e893f tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:19.318224 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-af1f9b2e-4c38-4164-9e08-9b55320e893f tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:19.439876 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-a6bc7669-e888-4c16-b278-47b2a4132c94 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:19.440390 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-a6bc7669-e888-4c16-b278-47b2a4132c94 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:19.450659 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a6bc7669-e888-4c16-b278-47b2a4132c94 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:19.451301 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a6bc7669-e888-4c16-b278-47b2a4132c94 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:19.452189 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a6bc7669-e888-4c16-b278-47b2a4132c94 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:19.453611 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a6bc7669-e888-4c16-b278-47b2a4132c94 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:19.454229 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a6bc7669-e888-4c16-b278-47b2a4132c94 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:19.455087 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a6bc7669-e888-4c16-b278-47b2a4132c94 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:19.471883 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-af1f9b2e-4c38-4164-9e08-9b55320e893f tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a39440ed016445a7bfc7ac7fba6661f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477dd0575c8741b0815ddf5f22297db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:19.489888 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-af1f9b2e-4c38-4164-9e08-9b55320e893f tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] 10.222.0.42 "GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16" status: 200 len: 1553 microversion: 2.1 time: 0.186072 Sep 16 01:55:19.496861 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 130/245] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:19 2022] GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16 => generated 1553 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:19.621058 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-a6bc7669-e888-4c16-b278-47b2a4132c94 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:19.630244 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-a6bc7669-e888-4c16-b278-47b2a4132c94 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1520 microversion: 2.1 time: 0.195881 Sep 16 01:55:19.630904 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 116/246] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:19 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1520 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:20.514438 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-d9bf3627-7791-4604-baa7-69665d958e28 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:20.515161 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-d9bf3627-7791-4604-baa7-69665d958e28 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] [instance: 33b0ab06-b40e-4c13-a33f-cd6a2881fd16] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:20.522655 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d9bf3627-7791-4604-baa7-69665d958e28 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:20.523266 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d9bf3627-7791-4604-baa7-69665d958e28 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:20.523766 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d9bf3627-7791-4604-baa7-69665d958e28 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:20.524558 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d9bf3627-7791-4604-baa7-69665d958e28 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:20.525089 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d9bf3627-7791-4604-baa7-69665d958e28 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:20.525577 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d9bf3627-7791-4604-baa7-69665d958e28 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:20.656017 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-a5138d07-67b4-4c30-ad02-8df1d2c0b363 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:20.656855 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-a5138d07-67b4-4c30-ad02-8df1d2c0b363 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:20.665613 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a5138d07-67b4-4c30-ad02-8df1d2c0b363 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:20.667142 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a5138d07-67b4-4c30-ad02-8df1d2c0b363 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:20.667876 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a5138d07-67b4-4c30-ad02-8df1d2c0b363 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:20.668829 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a5138d07-67b4-4c30-ad02-8df1d2c0b363 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:20.669515 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a5138d07-67b4-4c30-ad02-8df1d2c0b363 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:20.670155 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a5138d07-67b4-4c30-ad02-8df1d2c0b363 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:20.688017 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-d9bf3627-7791-4604-baa7-69665d958e28 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a39440ed016445a7bfc7ac7fba6661f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477dd0575c8741b0815ddf5f22297db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:20.717860 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-d9bf3627-7791-4604-baa7-69665d958e28 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] 10.222.0.42 "GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16" status: 200 len: 1553 microversion: 2.1 time: 0.205808 Sep 16 01:55:20.718705 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 131/247] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:20 2022] GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16 => generated 1553 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:20.850498 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-a5138d07-67b4-4c30-ad02-8df1d2c0b363 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:20.860306 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-a5138d07-67b4-4c30-ad02-8df1d2c0b363 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1520 microversion: 2.1 time: 0.209440 Sep 16 01:55:20.860899 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 117/248] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:20 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1520 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:21.679165 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [req-4cb856d6-726b-4238-8da1-0a61869288d7 req-bd159633-3505-4905-85b4-92382a125ae4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "33b0ab06-b40e-4c13-a33f-cd6a2881fd16", "name": "network-vif-deleted", "tag": "fa997e48-0418-472d-a98e-8a93319ff371"}]} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:55:21.689118 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-4cb856d6-726b-4238-8da1-0a61869288d7 req-bd159633-3505-4905-85b4-92382a125ae4 service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:21.689582 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-4cb856d6-726b-4238-8da1-0a61869288d7 req-bd159633-3505-4905-85b4-92382a125ae4 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:21.689999 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-4cb856d6-726b-4238-8da1-0a61869288d7 req-bd159633-3505-4905-85b4-92382a125ae4 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:21.702621 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.compute.server_external_events [req-4cb856d6-726b-4238-8da1-0a61869288d7 req-bd159633-3505-4905-85b4-92382a125ae4 service nova] Creating event network-vif-deleted:fa997e48-0418-472d-a98e-8a93319ff371 for instance 33b0ab06-b40e-4c13-a33f-cd6a2881fd16 on hv-cinder-84914 Sep 16 01:55:21.708777 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [req-4cb856d6-726b-4238-8da1-0a61869288d7 req-bd159633-3505-4905-85b4-92382a125ae4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033443 Sep 16 01:55:21.709399 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 132/249] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 01:55:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:55:21.742245 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-4c6aaab9-93ec-4478-96a3-ecea58bdd615 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:21.743520 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-4c6aaab9-93ec-4478-96a3-ecea58bdd615 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] [instance: 33b0ab06-b40e-4c13-a33f-cd6a2881fd16] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:21.757119 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-4c6aaab9-93ec-4478-96a3-ecea58bdd615 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:21.757617 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-4c6aaab9-93ec-4478-96a3-ecea58bdd615 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:21.758061 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-4c6aaab9-93ec-4478-96a3-ecea58bdd615 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:21.758824 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-4c6aaab9-93ec-4478-96a3-ecea58bdd615 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:21.759332 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-4c6aaab9-93ec-4478-96a3-ecea58bdd615 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:21.759771 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-4c6aaab9-93ec-4478-96a3-ecea58bdd615 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:21.841402 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-4c6aaab9-93ec-4478-96a3-ecea58bdd615 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a39440ed016445a7bfc7ac7fba6661f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477dd0575c8741b0815ddf5f22297db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:21.851336 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-4c6aaab9-93ec-4478-96a3-ecea58bdd615 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] 10.222.0.42 "GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16" status: 200 len: 1346 microversion: 2.1 time: 0.114128 Sep 16 01:55:21.851925 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 118/250] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:21 2022] GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16 => generated 1346 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:21.884173 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-7431b553-e7f1-4f28-a7a9-a3667d4a1d7d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:21.884817 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-7431b553-e7f1-4f28-a7a9-a3667d4a1d7d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:21.891044 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7431b553-e7f1-4f28-a7a9-a3667d4a1d7d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:21.891524 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7431b553-e7f1-4f28-a7a9-a3667d4a1d7d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:21.891981 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7431b553-e7f1-4f28-a7a9-a3667d4a1d7d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:21.892664 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7431b553-e7f1-4f28-a7a9-a3667d4a1d7d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:21.893119 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7431b553-e7f1-4f28-a7a9-a3667d4a1d7d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:21.893538 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7431b553-e7f1-4f28-a7a9-a3667d4a1d7d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:22.031458 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-7431b553-e7f1-4f28-a7a9-a3667d4a1d7d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:22.039168 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-7431b553-e7f1-4f28-a7a9-a3667d4a1d7d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1520 microversion: 2.1 time: 0.160285 Sep 16 01:55:22.039732 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 133/251] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:21 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:22.874673 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-38ec957a-aee9-4f30-b132-e09229842bb4 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:22.875359 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-38ec957a-aee9-4f30-b132-e09229842bb4 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] [instance: 33b0ab06-b40e-4c13-a33f-cd6a2881fd16] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:22.882861 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-38ec957a-aee9-4f30-b132-e09229842bb4 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:22.883338 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-38ec957a-aee9-4f30-b132-e09229842bb4 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:22.883804 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-38ec957a-aee9-4f30-b132-e09229842bb4 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:22.884493 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-38ec957a-aee9-4f30-b132-e09229842bb4 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:22.884997 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-38ec957a-aee9-4f30-b132-e09229842bb4 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:22.885414 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-38ec957a-aee9-4f30-b132-e09229842bb4 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:22.922307 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-38ec957a-aee9-4f30-b132-e09229842bb4 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:22.922838 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-38ec957a-aee9-4f30-b132-e09229842bb4 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:22.923269 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-38ec957a-aee9-4f30-b132-e09229842bb4 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:22.923705 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.objects.instance [None req-38ec957a-aee9-4f30-b132-e09229842bb4 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lazy-loading 'fault' on Instance uuid 33b0ab06-b40e-4c13-a33f-cd6a2881fd16 {{(pid=120440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 01:55:22.972658 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-38ec957a-aee9-4f30-b132-e09229842bb4 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a39440ed016445a7bfc7ac7fba6661f2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '477dd0575c8741b0815ddf5f22297db3', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:22.981327 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-38ec957a-aee9-4f30-b132-e09229842bb4 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] 10.222.0.42 "GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16" status: 200 len: 1351 microversion: 2.1 time: 0.110634 Sep 16 01:55:22.981883 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 119/252] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:22 2022] GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16 => generated 1351 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:23.062716 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-501f390f-34a5-4d7a-b927-1529a99a6900 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:23.063255 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-501f390f-34a5-4d7a-b927-1529a99a6900 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:23.069463 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-501f390f-34a5-4d7a-b927-1529a99a6900 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:23.069944 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-501f390f-34a5-4d7a-b927-1529a99a6900 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:23.070375 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-501f390f-34a5-4d7a-b927-1529a99a6900 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:23.071089 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-501f390f-34a5-4d7a-b927-1529a99a6900 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:23.071563 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-501f390f-34a5-4d7a-b927-1529a99a6900 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:23.071998 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-501f390f-34a5-4d7a-b927-1529a99a6900 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:23.204855 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-501f390f-34a5-4d7a-b927-1529a99a6900 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:23.214125 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-501f390f-34a5-4d7a-b927-1529a99a6900 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1520 microversion: 2.1 time: 0.155661 Sep 16 01:55:23.214690 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 134/253] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:23 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1520 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:24.007144 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-279aa9d1-d500-4267-a08b-50e41484c926 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:24.007909 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-279aa9d1-d500-4267-a08b-50e41484c926 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] [instance: 33b0ab06-b40e-4c13-a33f-cd6a2881fd16] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:24.017334 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-279aa9d1-d500-4267-a08b-50e41484c926 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:24.017821 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-279aa9d1-d500-4267-a08b-50e41484c926 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:24.018266 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-279aa9d1-d500-4267-a08b-50e41484c926 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:24.019015 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-279aa9d1-d500-4267-a08b-50e41484c926 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:24.019978 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-279aa9d1-d500-4267-a08b-50e41484c926 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:24.020413 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-279aa9d1-d500-4267-a08b-50e41484c926 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:24.033311 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.wsgi [None req-279aa9d1-d500-4267-a08b-50e41484c926 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] HTTP exception thrown: Instance 33b0ab06-b40e-4c13-a33f-cd6a2881fd16 could not be found. Sep 16 01:55:24.038033 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-279aa9d1-d500-4267-a08b-50e41484c926 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Request method failure captured: Sep 16 01:55:24.038033 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: request: GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16 HTTP/1.1 Sep 16 01:55:24.038033 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept: application/json Sep 16 01:55:24.038033 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept-Encoding: identity Sep 16 01:55:24.038033 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Connection: close Sep 16 01:55:24.038033 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Length: 0 Sep 16 01:55:24.038033 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Type: application/json Sep 16 01:55:24.038033 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Host: 10.222.0.42 Sep 16 01:55:24.038033 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Openstack-System-Scope: None Sep 16 01:55:24.038033 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: User-Agent: python-urllib3/1.26.12 Sep 16 01:55:24.038033 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Auth-Token: gAAAAABjI9c20hZ3Gj5JOHRA9pqXSffLe1S26OJJ8grTW8tm3nA_lejG45Zn1YGQGZgw28EAvjO7DeXmHbAKCxRM8T9Uzz0UcJYUQs_7tBpuMKQxqb8vSjOwLewDV5zrcMymztNBS7SOtdspdRKUFPMEgPpAWn_GPnhJABWzUMAhniyz97fkqag Sep 16 01:55:24.038033 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Id: None Sep 16 01:55:24.038033 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Name: None Sep 16 01:55:24.038033 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Identity-Status: Confirmed Sep 16 01:55:24.038033 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Is-Admin-Project: True Sep 16 01:55:24.038033 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Id: default Sep 16 01:55:24.038033 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Name: Default Sep 16 01:55:24.038033 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Id: 477dd0575c8741b0815ddf5f22297db3 Sep 16 01:55:24.038033 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Name: tempest-DeleteServersTestJSON-1720425330 Sep 16 01:55:24.038033 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Role: member,reader Sep 16 01:55:24.038033 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Roles: member,reader Sep 16 01:55:24.039297 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/477dd0575c8741b0815ddf5f22297db3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/477dd0575c8741b0815ddf5f22297db3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_477dd0575c8741b0815ddf5f22297db3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/477dd0575c8741b0815ddf5f22297db3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 01:55:24.039297 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant: tempest-DeleteServersTestJSON-1720425330 Sep 16 01:55:24.039297 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Id: 477dd0575c8741b0815ddf5f22297db3 Sep 16 01:55:24.039297 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Name: tempest-DeleteServersTestJSON-1720425330 Sep 16 01:55:24.039297 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User: tempest-DeleteServersTestJSON-1720425330-project Sep 16 01:55:24.039297 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Id: default Sep 16 01:55:24.039297 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Name: Default Sep 16 01:55:24.039297 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Id: a39440ed016445a7bfc7ac7fba6661f2 Sep 16 01:55:24.039297 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Name: tempest-DeleteServersTestJSON-1720425330-project Sep 16 01:55:24.039297 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: method: > Sep 16 01:55:24.039297 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: exception: Instance 33b0ab06-b40e-4c13-a33f-cd6a2881fd16 could not be found. Sep 16 01:55:24.039297 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: action_args: {'id': '33b0ab06-b40e-4c13-a33f-cd6a2881fd16'} Sep 16 01:55:24.040018 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 01:55:24.040018 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:55:24.040018 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 01:55:24.040018 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 01:55:24.040018 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 01:55:24.040018 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 01:55:24.040018 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 01:55:24.040018 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 01:55:24.040018 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 01:55:24.040018 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 01:55:24.040018 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33b0ab06-b40e-4c13-a33f-cd6a2881fd16 could not be found. Sep 16 01:55:24.040018 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 01:55:24.040018 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:55:24.040018 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 01:55:24.040018 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:55:24.040018 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 01:55:24.040018 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 01:55:24.040018 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 01:55:24.040018 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 01:55:24.040018 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 01:55:24.041130 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 01:55:24.041130 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 01:55:24.041130 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 01:55:24.041130 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 01:55:24.041130 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 01:55:24.041130 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 01:55:24.041130 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 01:55:24.041130 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33b0ab06-b40e-4c13-a33f-cd6a2881fd16 could not be found. Sep 16 01:55:24.041130 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 01:55:24.041130 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:55:24.041130 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 01:55:24.041130 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:55:24.041130 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 01:55:24.041130 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 01:55:24.041130 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 01:55:24.041130 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 01:55:24.041130 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33b0ab06-b40e-4c13-a33f-cd6a2881fd16 could not be found. Sep 16 01:55:24.041130 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 01:55:24.042092 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-279aa9d1-d500-4267-a08b-50e41484c926 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Returning 404 to user: Instance 33b0ab06-b40e-4c13-a33f-cd6a2881fd16 could not be found. {{(pid=120440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 01:55:24.042092 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-279aa9d1-d500-4267-a08b-50e41484c926 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] 10.222.0.42 "GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16" status: 404 len: 111 microversion: 2.1 time: 0.038257 Sep 16 01:55:24.043397 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 120/254] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:23 2022] GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16 => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 01:55:24.165875 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-7b4a7ab4-e68a-40ef-80ad-cc91323e3403 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:24.168142 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-7b4a7ab4-e68a-40ef-80ad-cc91323e3403 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] [instance: 33b0ab06-b40e-4c13-a33f-cd6a2881fd16] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:24.174438 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7b4a7ab4-e68a-40ef-80ad-cc91323e3403 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:24.175030 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7b4a7ab4-e68a-40ef-80ad-cc91323e3403 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:24.176244 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7b4a7ab4-e68a-40ef-80ad-cc91323e3403 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:24.177130 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7b4a7ab4-e68a-40ef-80ad-cc91323e3403 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:24.177765 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7b4a7ab4-e68a-40ef-80ad-cc91323e3403 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:24.178190 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7b4a7ab4-e68a-40ef-80ad-cc91323e3403 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:24.192673 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.wsgi [None req-7b4a7ab4-e68a-40ef-80ad-cc91323e3403 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] HTTP exception thrown: Instance 33b0ab06-b40e-4c13-a33f-cd6a2881fd16 could not be found. Sep 16 01:55:24.196804 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-7b4a7ab4-e68a-40ef-80ad-cc91323e3403 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Request method failure captured: Sep 16 01:55:24.196804 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: request: GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16/os-volume_attachments HTTP/1.1 Sep 16 01:55:24.196804 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Accept: application/json Sep 16 01:55:24.196804 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Accept-Encoding: identity Sep 16 01:55:24.196804 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Connection: close Sep 16 01:55:24.196804 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Content-Length: 0 Sep 16 01:55:24.196804 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Content-Type: application/json Sep 16 01:55:24.196804 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Host: 10.222.0.42 Sep 16 01:55:24.196804 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Openstack-System-Scope: None Sep 16 01:55:24.196804 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: User-Agent: python-urllib3/1.26.12 Sep 16 01:55:24.196804 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Auth-Token: gAAAAABjI9c20hZ3Gj5JOHRA9pqXSffLe1S26OJJ8grTW8tm3nA_lejG45Zn1YGQGZgw28EAvjO7DeXmHbAKCxRM8T9Uzz0UcJYUQs_7tBpuMKQxqb8vSjOwLewDV5zrcMymztNBS7SOtdspdRKUFPMEgPpAWn_GPnhJABWzUMAhniyz97fkqag Sep 16 01:55:24.196804 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Domain-Id: None Sep 16 01:55:24.196804 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Domain-Name: None Sep 16 01:55:24.196804 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Identity-Status: Confirmed Sep 16 01:55:24.196804 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Is-Admin-Project: True Sep 16 01:55:24.196804 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Domain-Id: default Sep 16 01:55:24.196804 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Domain-Name: Default Sep 16 01:55:24.196804 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Id: 477dd0575c8741b0815ddf5f22297db3 Sep 16 01:55:24.196804 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Name: tempest-DeleteServersTestJSON-1720425330 Sep 16 01:55:24.196804 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Role: member,reader Sep 16 01:55:24.196804 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Roles: member,reader Sep 16 01:55:24.198257 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/477dd0575c8741b0815ddf5f22297db3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/477dd0575c8741b0815ddf5f22297db3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_477dd0575c8741b0815ddf5f22297db3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/477dd0575c8741b0815ddf5f22297db3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 01:55:24.198257 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant: tempest-DeleteServersTestJSON-1720425330 Sep 16 01:55:24.198257 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant-Id: 477dd0575c8741b0815ddf5f22297db3 Sep 16 01:55:24.198257 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant-Name: tempest-DeleteServersTestJSON-1720425330 Sep 16 01:55:24.198257 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User: tempest-DeleteServersTestJSON-1720425330-project Sep 16 01:55:24.198257 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Domain-Id: default Sep 16 01:55:24.198257 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Domain-Name: Default Sep 16 01:55:24.198257 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Id: a39440ed016445a7bfc7ac7fba6661f2 Sep 16 01:55:24.198257 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Name: tempest-DeleteServersTestJSON-1720425330-project Sep 16 01:55:24.198257 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: method: > Sep 16 01:55:24.198257 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: exception: Instance 33b0ab06-b40e-4c13-a33f-cd6a2881fd16 could not be found. Sep 16 01:55:24.198257 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: action_args: {'server_id': '33b0ab06-b40e-4c13-a33f-cd6a2881fd16'} Sep 16 01:55:24.199055 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 01:55:24.199055 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:55:24.199055 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 01:55:24.199055 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 01:55:24.199055 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 01:55:24.199055 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 01:55:24.199055 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 01:55:24.199055 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 01:55:24.199055 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 01:55:24.199055 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 01:55:24.199055 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33b0ab06-b40e-4c13-a33f-cd6a2881fd16 could not be found. Sep 16 01:55:24.199055 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:55:24.199055 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:55:24.199055 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:55:24.199055 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:55:24.199055 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 01:55:24.199055 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 01:55:24.199055 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 01:55:24.199055 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 01:55:24.199055 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 01:55:24.200359 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 01:55:24.200359 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 16 01:55:24.200359 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 01:55:24.200359 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 16 01:55:24.200359 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 01:55:24.200359 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 16 01:55:24.200359 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 16 01:55:24.200359 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 01:55:24.200359 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 01:55:24.200359 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33b0ab06-b40e-4c13-a33f-cd6a2881fd16 could not be found. Sep 16 01:55:24.200359 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:55:24.200359 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:55:24.200359 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:55:24.200359 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:55:24.200359 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 01:55:24.200359 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 01:55:24.200359 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 01:55:24.200359 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 01:55:24.200359 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33b0ab06-b40e-4c13-a33f-cd6a2881fd16 could not be found. Sep 16 01:55:24.200359 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:55:24.201626 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-7b4a7ab4-e68a-40ef-80ad-cc91323e3403 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Returning 404 to user: Instance 33b0ab06-b40e-4c13-a33f-cd6a2881fd16 could not be found. {{(pid=120441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 01:55:24.201626 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-7b4a7ab4-e68a-40ef-80ad-cc91323e3403 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] 10.222.0.42 "GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.036358 Sep 16 01:55:24.201626 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 135/255] 10.222.0.42 () {58 vars in 1302 bytes} [Fri Sep 16 01:55:24 2022] GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16/os-volume_attachments => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 01:55:24.239790 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-8bea67d9-b386-46b8-950b-db8204cb8b03 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:24.240706 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-8bea67d9-b386-46b8-950b-db8204cb8b03 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:24.256179 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8bea67d9-b386-46b8-950b-db8204cb8b03 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:24.256179 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8bea67d9-b386-46b8-950b-db8204cb8b03 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:24.256351 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8bea67d9-b386-46b8-950b-db8204cb8b03 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:24.256926 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8bea67d9-b386-46b8-950b-db8204cb8b03 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:24.257378 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8bea67d9-b386-46b8-950b-db8204cb8b03 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:24.257799 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8bea67d9-b386-46b8-950b-db8204cb8b03 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:24.416346 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-8bea67d9-b386-46b8-950b-db8204cb8b03 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:24.424311 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-8bea67d9-b386-46b8-950b-db8204cb8b03 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1520 microversion: 2.1 time: 0.189295 Sep 16 01:55:24.424850 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 121/256] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:24 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1520 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:25.429133 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-983c182a-daaf-4e71-9389-e2204ff10168 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:25.429799 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-983c182a-daaf-4e71-9389-e2204ff10168 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] [instance: 33b0ab06-b40e-4c13-a33f-cd6a2881fd16] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:25.436551 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-983c182a-daaf-4e71-9389-e2204ff10168 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:25.437130 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-983c182a-daaf-4e71-9389-e2204ff10168 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:25.437645 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-983c182a-daaf-4e71-9389-e2204ff10168 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:25.438389 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-983c182a-daaf-4e71-9389-e2204ff10168 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:25.438843 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-983c182a-daaf-4e71-9389-e2204ff10168 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:25.439294 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-983c182a-daaf-4e71-9389-e2204ff10168 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:25.449304 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-db60b71e-4384-4d8e-bb90-83e5bed11931 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:25.450268 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-db60b71e-4384-4d8e-bb90-83e5bed11931 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:25.457987 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-db60b71e-4384-4d8e-bb90-83e5bed11931 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:25.458697 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-db60b71e-4384-4d8e-bb90-83e5bed11931 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:25.458843 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.wsgi [None req-983c182a-daaf-4e71-9389-e2204ff10168 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] HTTP exception thrown: Instance 33b0ab06-b40e-4c13-a33f-cd6a2881fd16 could not be found. Sep 16 01:55:25.459333 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-db60b71e-4384-4d8e-bb90-83e5bed11931 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:25.460431 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-db60b71e-4384-4d8e-bb90-83e5bed11931 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:25.460984 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-983c182a-daaf-4e71-9389-e2204ff10168 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Request method failure captured: Sep 16 01:55:25.460984 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: request: DELETE /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16 HTTP/1.1 Sep 16 01:55:25.460984 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Accept: application/json Sep 16 01:55:25.460984 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Accept-Encoding: identity Sep 16 01:55:25.460984 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Connection: close Sep 16 01:55:25.460984 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Content-Length: 0 Sep 16 01:55:25.460984 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Content-Type: application/json Sep 16 01:55:25.460984 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Host: 10.222.0.42 Sep 16 01:55:25.460984 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Openstack-System-Scope: None Sep 16 01:55:25.460984 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: User-Agent: python-urllib3/1.26.12 Sep 16 01:55:25.460984 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Auth-Token: gAAAAABjI9c20hZ3Gj5JOHRA9pqXSffLe1S26OJJ8grTW8tm3nA_lejG45Zn1YGQGZgw28EAvjO7DeXmHbAKCxRM8T9Uzz0UcJYUQs_7tBpuMKQxqb8vSjOwLewDV5zrcMymztNBS7SOtdspdRKUFPMEgPpAWn_GPnhJABWzUMAhniyz97fkqag Sep 16 01:55:25.460984 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Domain-Id: None Sep 16 01:55:25.460984 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Domain-Name: None Sep 16 01:55:25.460984 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Identity-Status: Confirmed Sep 16 01:55:25.460984 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Is-Admin-Project: True Sep 16 01:55:25.460984 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Domain-Id: default Sep 16 01:55:25.460984 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Domain-Name: Default Sep 16 01:55:25.460984 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Id: 477dd0575c8741b0815ddf5f22297db3 Sep 16 01:55:25.460984 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Name: tempest-DeleteServersTestJSON-1720425330 Sep 16 01:55:25.460984 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Role: member,reader Sep 16 01:55:25.460984 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Roles: member,reader Sep 16 01:55:25.462252 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/477dd0575c8741b0815ddf5f22297db3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/477dd0575c8741b0815ddf5f22297db3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_477dd0575c8741b0815ddf5f22297db3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/477dd0575c8741b0815ddf5f22297db3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 01:55:25.462252 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant: tempest-DeleteServersTestJSON-1720425330 Sep 16 01:55:25.462252 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant-Id: 477dd0575c8741b0815ddf5f22297db3 Sep 16 01:55:25.462252 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant-Name: tempest-DeleteServersTestJSON-1720425330 Sep 16 01:55:25.462252 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User: tempest-DeleteServersTestJSON-1720425330-project Sep 16 01:55:25.462252 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Domain-Id: default Sep 16 01:55:25.462252 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Domain-Name: Default Sep 16 01:55:25.462252 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Id: a39440ed016445a7bfc7ac7fba6661f2 Sep 16 01:55:25.462252 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Name: tempest-DeleteServersTestJSON-1720425330-project Sep 16 01:55:25.462252 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: method: > Sep 16 01:55:25.462252 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: exception: Instance 33b0ab06-b40e-4c13-a33f-cd6a2881fd16 could not be found. Sep 16 01:55:25.462252 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: action_args: {'id': '33b0ab06-b40e-4c13-a33f-cd6a2881fd16'} Sep 16 01:55:25.462906 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 01:55:25.462906 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:55:25.462906 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 01:55:25.462906 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 01:55:25.462906 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 01:55:25.462906 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 01:55:25.462906 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 01:55:25.462906 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 01:55:25.462906 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 01:55:25.462906 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 01:55:25.462906 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33b0ab06-b40e-4c13-a33f-cd6a2881fd16 could not be found. Sep 16 01:55:25.462906 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:55:25.462906 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:55:25.462906 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:55:25.462906 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:55:25.462906 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 01:55:25.462906 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 01:55:25.462906 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 01:55:25.462906 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 01:55:25.462906 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 01:55:25.464398 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 01:55:25.464398 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 01:55:25.464398 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 01:55:25.464398 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 01:55:25.464398 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 01:55:25.464398 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 01:55:25.464398 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 01:55:25.464398 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 01:55:25.464398 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 01:55:25.464398 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33b0ab06-b40e-4c13-a33f-cd6a2881fd16 could not be found. Sep 16 01:55:25.464398 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:55:25.464398 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:55:25.464398 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:55:25.464398 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:55:25.464398 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 01:55:25.464398 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 01:55:25.464398 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 01:55:25.464398 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 01:55:25.464398 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33b0ab06-b40e-4c13-a33f-cd6a2881fd16 could not be found. Sep 16 01:55:25.464398 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:55:25.465838 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-db60b71e-4384-4d8e-bb90-83e5bed11931 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:25.465838 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-db60b71e-4384-4d8e-bb90-83e5bed11931 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:25.465973 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-983c182a-daaf-4e71-9389-e2204ff10168 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Returning 404 to user: Instance 33b0ab06-b40e-4c13-a33f-cd6a2881fd16 could not be found. {{(pid=120441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 01:55:25.465973 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-983c182a-daaf-4e71-9389-e2204ff10168 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] 10.222.0.42 "DELETE /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16" status: 404 len: 111 microversion: 2.1 time: 0.037135 Sep 16 01:55:25.465973 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 136/257] 10.222.0.42 () {58 vars in 1239 bytes} [Fri Sep 16 01:55:25 2022] DELETE /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 01:55:25.472072 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-772d128e-5d68-4227-9c14-42ae111a01a5 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:25.472824 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-772d128e-5d68-4227-9c14-42ae111a01a5 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] [instance: 33b0ab06-b40e-4c13-a33f-cd6a2881fd16] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:25.482732 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-772d128e-5d68-4227-9c14-42ae111a01a5 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:25.483845 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-772d128e-5d68-4227-9c14-42ae111a01a5 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:25.484367 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-772d128e-5d68-4227-9c14-42ae111a01a5 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:25.485062 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-772d128e-5d68-4227-9c14-42ae111a01a5 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:25.485506 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-772d128e-5d68-4227-9c14-42ae111a01a5 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:25.486213 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-772d128e-5d68-4227-9c14-42ae111a01a5 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:25.501625 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.wsgi [None req-772d128e-5d68-4227-9c14-42ae111a01a5 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] HTTP exception thrown: Instance 33b0ab06-b40e-4c13-a33f-cd6a2881fd16 could not be found. Sep 16 01:55:25.503719 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-772d128e-5d68-4227-9c14-42ae111a01a5 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Request method failure captured: Sep 16 01:55:25.503719 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: request: GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16 HTTP/1.1 Sep 16 01:55:25.503719 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Accept: application/json Sep 16 01:55:25.503719 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Accept-Encoding: identity Sep 16 01:55:25.503719 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Connection: close Sep 16 01:55:25.503719 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Content-Length: 0 Sep 16 01:55:25.503719 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Content-Type: application/json Sep 16 01:55:25.503719 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Host: 10.222.0.42 Sep 16 01:55:25.503719 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Openstack-System-Scope: None Sep 16 01:55:25.503719 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: User-Agent: python-urllib3/1.26.12 Sep 16 01:55:25.503719 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Auth-Token: gAAAAABjI9c20hZ3Gj5JOHRA9pqXSffLe1S26OJJ8grTW8tm3nA_lejG45Zn1YGQGZgw28EAvjO7DeXmHbAKCxRM8T9Uzz0UcJYUQs_7tBpuMKQxqb8vSjOwLewDV5zrcMymztNBS7SOtdspdRKUFPMEgPpAWn_GPnhJABWzUMAhniyz97fkqag Sep 16 01:55:25.503719 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Domain-Id: None Sep 16 01:55:25.503719 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Domain-Name: None Sep 16 01:55:25.503719 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Identity-Status: Confirmed Sep 16 01:55:25.503719 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Is-Admin-Project: True Sep 16 01:55:25.503719 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Domain-Id: default Sep 16 01:55:25.503719 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Domain-Name: Default Sep 16 01:55:25.503719 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Id: 477dd0575c8741b0815ddf5f22297db3 Sep 16 01:55:25.503719 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Name: tempest-DeleteServersTestJSON-1720425330 Sep 16 01:55:25.503719 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Role: member,reader Sep 16 01:55:25.503719 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Roles: member,reader Sep 16 01:55:25.505543 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/477dd0575c8741b0815ddf5f22297db3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/477dd0575c8741b0815ddf5f22297db3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_477dd0575c8741b0815ddf5f22297db3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/477dd0575c8741b0815ddf5f22297db3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 01:55:25.505543 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant: tempest-DeleteServersTestJSON-1720425330 Sep 16 01:55:25.505543 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant-Id: 477dd0575c8741b0815ddf5f22297db3 Sep 16 01:55:25.505543 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant-Name: tempest-DeleteServersTestJSON-1720425330 Sep 16 01:55:25.505543 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User: tempest-DeleteServersTestJSON-1720425330-project Sep 16 01:55:25.505543 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Domain-Id: default Sep 16 01:55:25.505543 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Domain-Name: Default Sep 16 01:55:25.505543 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Id: a39440ed016445a7bfc7ac7fba6661f2 Sep 16 01:55:25.505543 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Name: tempest-DeleteServersTestJSON-1720425330-project Sep 16 01:55:25.505543 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: method: > Sep 16 01:55:25.505543 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: exception: Instance 33b0ab06-b40e-4c13-a33f-cd6a2881fd16 could not be found. Sep 16 01:55:25.505543 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: action_args: {'id': '33b0ab06-b40e-4c13-a33f-cd6a2881fd16'} Sep 16 01:55:25.506186 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 01:55:25.506186 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:55:25.506186 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 01:55:25.506186 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 01:55:25.506186 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 01:55:25.506186 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 01:55:25.506186 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 01:55:25.506186 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 01:55:25.506186 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 01:55:25.506186 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 01:55:25.506186 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 33b0ab06-b40e-4c13-a33f-cd6a2881fd16 could not be found. Sep 16 01:55:25.506186 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:55:25.506186 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:55:25.506186 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:55:25.506186 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:55:25.506186 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 01:55:25.506186 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 01:55:25.506186 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 01:55:25.506186 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 01:55:25.506186 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 01:55:25.510021 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 01:55:25.510021 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 01:55:25.510021 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 01:55:25.510021 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 01:55:25.510021 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 01:55:25.510021 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 01:55:25.510021 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 01:55:25.510021 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 33b0ab06-b40e-4c13-a33f-cd6a2881fd16 could not be found. Sep 16 01:55:25.510021 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:55:25.510021 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:55:25.510021 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:55:25.510021 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:55:25.510021 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 01:55:25.510021 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 01:55:25.510021 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 01:55:25.510021 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 01:55:25.510021 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 33b0ab06-b40e-4c13-a33f-cd6a2881fd16 could not be found. Sep 16 01:55:25.510021 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:55:25.512603 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-772d128e-5d68-4227-9c14-42ae111a01a5 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] Returning 404 to user: Instance 33b0ab06-b40e-4c13-a33f-cd6a2881fd16 could not be found. {{(pid=120441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 01:55:25.512603 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-772d128e-5d68-4227-9c14-42ae111a01a5 tempest-DeleteServersTestJSON-1720425330 tempest-DeleteServersTestJSON-1720425330-project] 10.222.0.42 "GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16" status: 404 len: 111 microversion: 2.1 time: 0.037570 Sep 16 01:55:25.512603 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 137/258] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:25 2022] GET /compute/v2.1/servers/33b0ab06-b40e-4c13-a33f-cd6a2881fd16 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 01:55:25.634924 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-db60b71e-4384-4d8e-bb90-83e5bed11931 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:25.643526 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-db60b71e-4384-4d8e-bb90-83e5bed11931 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1520 microversion: 2.1 time: 0.199690 Sep 16 01:55:25.644337 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 122/259] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:25 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1520 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 01:55:26.667074 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-655c60a9-9862-4545-a863-7c1ca5467ead tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:26.667909 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-655c60a9-9862-4545-a863-7c1ca5467ead tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:26.674282 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-655c60a9-9862-4545-a863-7c1ca5467ead tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:26.674845 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-655c60a9-9862-4545-a863-7c1ca5467ead tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:26.675429 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-655c60a9-9862-4545-a863-7c1ca5467ead tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:26.676378 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-655c60a9-9862-4545-a863-7c1ca5467ead tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:26.677026 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-655c60a9-9862-4545-a863-7c1ca5467ead tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:26.677599 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-655c60a9-9862-4545-a863-7c1ca5467ead tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:26.916735 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-655c60a9-9862-4545-a863-7c1ca5467ead tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:26.924780 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-655c60a9-9862-4545-a863-7c1ca5467ead tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1520 microversion: 2.1 time: 0.261730 Sep 16 01:55:26.926896 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 138/260] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:26 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1520 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:27.949529 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-78c6970a-384a-4e48-a985-c1503274bb31 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:27.950276 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-78c6970a-384a-4e48-a985-c1503274bb31 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:27.952951 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:55:27.959418 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-78c6970a-384a-4e48-a985-c1503274bb31 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:27.960020 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-78c6970a-384a-4e48-a985-c1503274bb31 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:27.960458 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-78c6970a-384a-4e48-a985-c1503274bb31 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:27.961144 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-78c6970a-384a-4e48-a985-c1503274bb31 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:27.961596 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-78c6970a-384a-4e48-a985-c1503274bb31 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:27.962017 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-78c6970a-384a-4e48-a985-c1503274bb31 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:27.966697 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:55:28.310382 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-78c6970a-384a-4e48-a985-c1503274bb31 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:28.319673 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-78c6970a-384a-4e48-a985-c1503274bb31 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1520 microversion: 2.1 time: 0.374259 Sep 16 01:55:28.330189 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 123/261] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:27 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1520 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:29.342930 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-c1b2266f-4087-499b-b2c6-968417ceffa7 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:29.343627 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-c1b2266f-4087-499b-b2c6-968417ceffa7 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:29.350546 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c1b2266f-4087-499b-b2c6-968417ceffa7 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:29.351306 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c1b2266f-4087-499b-b2c6-968417ceffa7 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:29.351749 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c1b2266f-4087-499b-b2c6-968417ceffa7 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:29.352555 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c1b2266f-4087-499b-b2c6-968417ceffa7 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:29.353018 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c1b2266f-4087-499b-b2c6-968417ceffa7 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:29.353446 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c1b2266f-4087-499b-b2c6-968417ceffa7 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:29.706101 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-c1b2266f-4087-499b-b2c6-968417ceffa7 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:29.709934 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell1:SELECT=100 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:55:29.718335 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-c1b2266f-4087-499b-b2c6-968417ceffa7 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1520 microversion: 2.1 time: 0.379267 Sep 16 01:55:29.718927 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 139/262] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:29 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1520 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:30.745852 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-dbd723ab-493b-4dee-85c9-841cc98d4cc5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:30.747176 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-dbd723ab-493b-4dee-85c9-841cc98d4cc5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:30.753796 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-dbd723ab-493b-4dee-85c9-841cc98d4cc5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:30.754283 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-dbd723ab-493b-4dee-85c9-841cc98d4cc5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:30.754970 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-dbd723ab-493b-4dee-85c9-841cc98d4cc5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:30.755819 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-dbd723ab-493b-4dee-85c9-841cc98d4cc5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:30.756487 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-dbd723ab-493b-4dee-85c9-841cc98d4cc5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:30.756910 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-dbd723ab-493b-4dee-85c9-841cc98d4cc5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:30.817902 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-7ad0ee56-0ea3-4b03-ac9d-09258e012f5f tempest-VolumesGetTestJSON-1208078966 tempest-VolumesGetTestJSON-1208078966-project] Action: 'create', calling method: .version_select at 0x7fae32c02e50>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-571850036", "metadata": {"Type": "work"}}} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:55:30.999060 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-dbd723ab-493b-4dee-85c9-841cc98d4cc5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:31.008160 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-dbd723ab-493b-4dee-85c9-841cc98d4cc5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1520 microversion: 2.1 time: 0.268180 Sep 16 01:55:31.021570 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 140/263] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:30 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1520 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 01:55:31.146106 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-7ad0ee56-0ea3-4b03-ac9d-09258e012f5f tempest-VolumesGetTestJSON-1208078966 tempest-VolumesGetTestJSON-1208078966-project] 10.222.0.42 "POST /compute/v2.1/os-volumes" status: 200 len: 352 microversion: 2.1 time: 0.480122 Sep 16 01:55:31.147561 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 124/264] 10.222.0.42 () {60 vars in 1156 bytes} [Fri Sep 16 01:55:30 2022] POST /compute/v2.1/os-volumes => generated 352 bytes in 482 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 16 01:55:31.163616 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-80e1a6f1-42d3-496d-b72e-a49d116171c5 tempest-VolumesGetTestJSON-1208078966 tempest-VolumesGetTestJSON-1208078966-project] Calling method '.version_select at 0x7fae32c18280>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:31.235595 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-80e1a6f1-42d3-496d-b72e-a49d116171c5 tempest-VolumesGetTestJSON-1208078966 tempest-VolumesGetTestJSON-1208078966-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/0fc28e89-7519-4630-9d41-51b744ebd08c" status: 200 len: 352 microversion: 2.1 time: 0.079010 Sep 16 01:55:31.236803 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 141/265] 10.222.0.42 () {58 vars in 1245 bytes} [Fri Sep 16 01:55:31 2022] GET /compute/v2.1/os-volumes/0fc28e89-7519-4630-9d41-51b744ebd08c => generated 352 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:55:32.034844 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-88388a47-da42-45ba-b89c-15ab6f9df07a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:32.035623 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-88388a47-da42-45ba-b89c-15ab6f9df07a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:32.042140 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-88388a47-da42-45ba-b89c-15ab6f9df07a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:32.042568 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-88388a47-da42-45ba-b89c-15ab6f9df07a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:32.043007 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-88388a47-da42-45ba-b89c-15ab6f9df07a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:32.043690 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-88388a47-da42-45ba-b89c-15ab6f9df07a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:32.044176 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-88388a47-da42-45ba-b89c-15ab6f9df07a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:32.044604 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-88388a47-da42-45ba-b89c-15ab6f9df07a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:32.180410 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-88388a47-da42-45ba-b89c-15ab6f9df07a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:32.188297 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-88388a47-da42-45ba-b89c-15ab6f9df07a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1520 microversion: 2.1 time: 0.158248 Sep 16 01:55:32.188990 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 125/266] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:32 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:32.249540 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-239e58f9-af11-4dca-86d1-b135715c2d1e tempest-VolumesGetTestJSON-1208078966 tempest-VolumesGetTestJSON-1208078966-project] Calling method '.version_select at 0x7fae3368c0d0>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:32.299842 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-239e58f9-af11-4dca-86d1-b135715c2d1e tempest-VolumesGetTestJSON-1208078966 tempest-VolumesGetTestJSON-1208078966-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/0fc28e89-7519-4630-9d41-51b744ebd08c" status: 200 len: 353 microversion: 2.1 time: 0.054084 Sep 16 01:55:32.300756 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 142/267] 10.222.0.42 () {58 vars in 1245 bytes} [Fri Sep 16 01:55:32 2022] GET /compute/v2.1/os-volumes/0fc28e89-7519-4630-9d41-51b744ebd08c => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:55:32.319468 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-16d1b059-65c0-429c-a19f-eea6bf147b12 tempest-VolumesGetTestJSON-1208078966 tempest-VolumesGetTestJSON-1208078966-project] Calling method '.version_select at 0x7fae32c02310>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:32.368177 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-16d1b059-65c0-429c-a19f-eea6bf147b12 tempest-VolumesGetTestJSON-1208078966 tempest-VolumesGetTestJSON-1208078966-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/0fc28e89-7519-4630-9d41-51b744ebd08c" status: 200 len: 353 microversion: 2.1 time: 0.052927 Sep 16 01:55:32.368734 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 126/268] 10.222.0.42 () {58 vars in 1245 bytes} [Fri Sep 16 01:55:32 2022] GET /compute/v2.1/os-volumes/0fc28e89-7519-4630-9d41-51b744ebd08c => generated 353 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:55:32.386385 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-1ae36bf1-86f2-4313-a61d-d1555460865b tempest-VolumesGetTestJSON-1208078966 tempest-VolumesGetTestJSON-1208078966-project] Calling method '.version_select at 0x7fae32c71c10>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:32.450359 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-1ae36bf1-86f2-4313-a61d-d1555460865b tempest-VolumesGetTestJSON-1208078966 tempest-VolumesGetTestJSON-1208078966-project] 10.222.0.42 "DELETE /compute/v2.1/os-volumes/0fc28e89-7519-4630-9d41-51b744ebd08c" status: 202 len: 0 microversion: 2.1 time: 0.067769 Sep 16 01:55:32.451075 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 143/269] 10.222.0.42 () {58 vars in 1248 bytes} [Fri Sep 16 01:55:32 2022] DELETE /compute/v2.1/os-volumes/0fc28e89-7519-4630-9d41-51b744ebd08c => generated 0 bytes in 69 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 01:55:32.459672 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-7be34fa4-67c6-415d-b046-2a560e8d2b16 tempest-VolumesGetTestJSON-1208078966 tempest-VolumesGetTestJSON-1208078966-project] Calling method '.version_select at 0x7fae32c02550>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:32.510422 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-7be34fa4-67c6-415d-b046-2a560e8d2b16 tempest-VolumesGetTestJSON-1208078966 tempest-VolumesGetTestJSON-1208078966-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/0fc28e89-7519-4630-9d41-51b744ebd08c" status: 200 len: 352 microversion: 2.1 time: 0.054955 Sep 16 01:55:32.511002 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 127/270] 10.222.0.42 () {58 vars in 1245 bytes} [Fri Sep 16 01:55:32 2022] GET /compute/v2.1/os-volumes/0fc28e89-7519-4630-9d41-51b744ebd08c => generated 352 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:55:33.210803 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-e511a153-e787-4d1d-b730-1f38f6616eb6 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:33.211439 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-e511a153-e787-4d1d-b730-1f38f6616eb6 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:33.218162 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e511a153-e787-4d1d-b730-1f38f6616eb6 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:33.218636 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e511a153-e787-4d1d-b730-1f38f6616eb6 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:33.219068 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e511a153-e787-4d1d-b730-1f38f6616eb6 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:33.219753 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e511a153-e787-4d1d-b730-1f38f6616eb6 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:33.220228 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e511a153-e787-4d1d-b730-1f38f6616eb6 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:33.220649 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e511a153-e787-4d1d-b730-1f38f6616eb6 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:33.356674 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-e511a153-e787-4d1d-b730-1f38f6616eb6 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:33.365046 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-e511a153-e787-4d1d-b730-1f38f6616eb6 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1520 microversion: 2.1 time: 0.158135 Sep 16 01:55:33.365609 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 144/271] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:33 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:33.524859 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-679c5d57-8a3a-4818-91b2-4f492db1ed56 tempest-VolumesGetTestJSON-1208078966 tempest-VolumesGetTestJSON-1208078966-project] Calling method '.version_select at 0x7fae32c0d3a0>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:33.554300 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.wsgi [None req-679c5d57-8a3a-4818-91b2-4f492db1ed56 tempest-VolumesGetTestJSON-1208078966 tempest-VolumesGetTestJSON-1208078966-project] HTTP exception thrown: Volume 0fc28e89-7519-4630-9d41-51b744ebd08c could not be found. Sep 16 01:55:33.556301 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-679c5d57-8a3a-4818-91b2-4f492db1ed56 tempest-VolumesGetTestJSON-1208078966 tempest-VolumesGetTestJSON-1208078966-project] Request method failure captured: Sep 16 01:55:33.556301 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: request: GET /compute/v2.1/os-volumes/0fc28e89-7519-4630-9d41-51b744ebd08c HTTP/1.1 Sep 16 01:55:33.556301 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept: application/json Sep 16 01:55:33.556301 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept-Encoding: identity Sep 16 01:55:33.556301 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Connection: close Sep 16 01:55:33.556301 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Length: 0 Sep 16 01:55:33.556301 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Type: application/json Sep 16 01:55:33.556301 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Host: 10.222.0.42 Sep 16 01:55:33.556301 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Openstack-System-Scope: None Sep 16 01:55:33.556301 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: User-Agent: python-urllib3/1.26.12 Sep 16 01:55:33.556301 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Auth-Token: gAAAAABjI9eS9_iskbAOnIEw82S2-nPWiV__dgSGtQo7Mog0MAcQBxi8uf3xSDtPPB8bGyby7WMr3AUQGcLGDXW1K4LWjU2k8ME_KVX5L25M6cWKXCu5UnNvzSENbJ9oaNjUwEMnHIGbVFPX15mn81C7BVH2R_te5vE6RB8UfdojZVre8KhowA8 Sep 16 01:55:33.556301 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Id: None Sep 16 01:55:33.556301 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Name: None Sep 16 01:55:33.556301 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Identity-Status: Confirmed Sep 16 01:55:33.556301 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Is-Admin-Project: True Sep 16 01:55:33.556301 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Id: default Sep 16 01:55:33.556301 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Name: Default Sep 16 01:55:33.556301 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Id: 7d25c483d30d4ac0b8818e5e6bdaaae3 Sep 16 01:55:33.556301 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Name: tempest-VolumesGetTestJSON-1208078966 Sep 16 01:55:33.556301 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Role: member,reader Sep 16 01:55:33.556301 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Roles: member,reader Sep 16 01:55:33.557773 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/7d25c483d30d4ac0b8818e5e6bdaaae3"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7d25c483d30d4ac0b8818e5e6bdaaae3"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_7d25c483d30d4ac0b8818e5e6bdaaae3"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/7d25c483d30d4ac0b8818e5e6bdaaae3"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 01:55:33.557773 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant: tempest-VolumesGetTestJSON-1208078966 Sep 16 01:55:33.557773 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Id: 7d25c483d30d4ac0b8818e5e6bdaaae3 Sep 16 01:55:33.557773 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Name: tempest-VolumesGetTestJSON-1208078966 Sep 16 01:55:33.557773 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User: tempest-VolumesGetTestJSON-1208078966-project Sep 16 01:55:33.557773 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Id: default Sep 16 01:55:33.557773 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Name: Default Sep 16 01:55:33.557773 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Id: 4a8ad2ec844a4eecbcaa442055762562 Sep 16 01:55:33.557773 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Name: tempest-VolumesGetTestJSON-1208078966-project Sep 16 01:55:33.557773 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: method: Sep 16 01:55:33.557773 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: exception: Volume 0fc28e89-7519-4630-9d41-51b744ebd08c could not be found. Sep 16 01:55:33.557773 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: action_args: {'id': '0fc28e89-7519-4630-9d41-51b744ebd08c'} Sep 16 01:55:33.557773 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 01:55:33.558746 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:55:33.558746 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 01:55:33.558746 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 01:55:33.558746 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 16 01:55:33.558746 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 16 01:55:33.558746 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 16 01:55:33.558746 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 16 01:55:33.558746 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 16 01:55:33.558746 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 16 01:55:33.558746 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 16 01:55:33.558746 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 16 01:55:33.558746 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 01:55:33.558746 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 01:55:33.558746 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 01:55:33.558746 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 01:55:33.558746 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 0fc28e89-7519-4630-9d41-51b744ebd08c could not be found. (HTTP 404) (Request-ID: req-0f45e415-e0b3-42ba-a1a2-170fb4e9d536) Sep 16 01:55:33.558746 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 01:55:33.558746 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:55:33.558746 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 01:55:33.560164 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:55:33.560164 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 16 01:55:33.560164 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 16 01:55:33.560164 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 16 01:55:33.560164 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 16 01:55:33.560164 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 16 01:55:33.560164 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 16 01:55:33.560164 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 16 01:55:33.560164 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 16 01:55:33.560164 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 01:55:33.560164 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 01:55:33.560164 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 16 01:55:33.560164 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 16 01:55:33.560164 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 16 01:55:33.560164 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 16 01:55:33.560164 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 16 01:55:33.560164 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 16 01:55:33.560164 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 16 01:55:33.560164 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 16 01:55:33.561608 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 01:55:33.561608 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 01:55:33.561608 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 01:55:33.561608 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 01:55:33.561608 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 0fc28e89-7519-4630-9d41-51b744ebd08c could not be found. Sep 16 01:55:33.561608 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 01:55:33.561608 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:55:33.561608 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 01:55:33.561608 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:55:33.561608 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 01:55:33.561608 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 01:55:33.561608 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 01:55:33.561608 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 01:55:33.561608 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 01:55:33.561608 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 01:55:33.561608 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 01:55:33.561608 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 01:55:33.561608 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 16 01:55:33.561608 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 01:55:33.562891 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 0fc28e89-7519-4630-9d41-51b744ebd08c could not be found. Sep 16 01:55:33.562891 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 01:55:33.562891 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:55:33.562891 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 01:55:33.562891 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:55:33.562891 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 01:55:33.562891 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 01:55:33.562891 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 01:55:33.562891 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 01:55:33.562891 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 0fc28e89-7519-4630-9d41-51b744ebd08c could not be found. Sep 16 01:55:33.562891 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 01:55:33.562891 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-679c5d57-8a3a-4818-91b2-4f492db1ed56 tempest-VolumesGetTestJSON-1208078966 tempest-VolumesGetTestJSON-1208078966-project] Returning 404 to user: Volume 0fc28e89-7519-4630-9d41-51b744ebd08c could not be found. {{(pid=120440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 01:55:33.562891 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-679c5d57-8a3a-4818-91b2-4f492db1ed56 tempest-VolumesGetTestJSON-1208078966 tempest-VolumesGetTestJSON-1208078966-project] 10.222.0.42 "GET /compute/v2.1/os-volumes/0fc28e89-7519-4630-9d41-51b744ebd08c" status: 404 len: 109 microversion: 2.1 time: 0.037176 Sep 16 01:55:33.562891 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 128/272] 10.222.0.42 () {58 vars in 1245 bytes} [Fri Sep 16 01:55:33 2022] GET /compute/v2.1/os-volumes/0fc28e89-7519-4630-9d41-51b744ebd08c => generated 109 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 01:55:33.989856 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-e28568d8-c7e5-45c9-9260-e6e6629d221a tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-764847133", "imageRef": "1546da04-912c-44c6-b4b9-34fba35e08f6", "flavorRef": "452", "networks": [{"uuid": "5464ac9b-c4e0-46ad-93ef-65f3628cf72c"}]}} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:55:34.050308 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.network.neutron [None req-e28568d8-c7e5-45c9-9260-e6e6629d221a tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] validate_networks() for [('5464ac9b-c4e0-46ad-93ef-65f3628cf72c', None, None, None, None, None)] {{(pid=120441) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 01:55:34.390076 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-1daa7ef3-db9e-46e0-adb5-3ab03ea7abdb tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:34.390796 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-1daa7ef3-db9e-46e0-adb5-3ab03ea7abdb tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:34.398282 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1daa7ef3-db9e-46e0-adb5-3ab03ea7abdb tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:34.399205 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1daa7ef3-db9e-46e0-adb5-3ab03ea7abdb tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:34.399713 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1daa7ef3-db9e-46e0-adb5-3ab03ea7abdb tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:34.400557 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1daa7ef3-db9e-46e0-adb5-3ab03ea7abdb tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:34.401010 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1daa7ef3-db9e-46e0-adb5-3ab03ea7abdb tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:34.401463 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1daa7ef3-db9e-46e0-adb5-3ab03ea7abdb tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:34.466189 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.virt.hardware [None req-e28568d8-c7e5-45c9-9260-e6e6629d221a tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Flavor limits 0:0:0 {{(pid=120441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 01:55:34.467414 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.virt.hardware [None req-e28568d8-c7e5-45c9-9260-e6e6629d221a tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Image limits 0:0:0 {{(pid=120441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 01:55:34.468364 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.virt.hardware [None req-e28568d8-c7e5-45c9-9260-e6e6629d221a tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Flavor pref 0:0:0 {{(pid=120441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 01:55:34.468919 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.virt.hardware [None req-e28568d8-c7e5-45c9-9260-e6e6629d221a tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Image pref 0:0:0 {{(pid=120441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 01:55:34.469885 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.virt.hardware [None req-e28568d8-c7e5-45c9-9260-e6e6629d221a tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 01:55:34.481634 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e28568d8-c7e5-45c9-9260-e6e6629d221a tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:34.482361 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e28568d8-c7e5-45c9-9260-e6e6629d221a tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:34.482882 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e28568d8-c7e5-45c9-9260-e6e6629d221a tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:34.483990 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e28568d8-c7e5-45c9-9260-e6e6629d221a tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:34.484504 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e28568d8-c7e5-45c9-9260-e6e6629d221a tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:34.485016 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e28568d8-c7e5-45c9-9260-e6e6629d221a tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:34.505518 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.quota [None req-e28568d8-c7e5-45c9-9260-e6e6629d221a tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Getting quotas for project 3a0380c941f644a794f51e1f575faf00. Resources: {'cores', 'ram', 'instances'} {{(pid=120441) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 01:55:34.510897 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.quota [None req-e28568d8-c7e5-45c9-9260-e6e6629d221a tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Getting quotas for user 47a422989ce94168a042135234bea46b and project 3a0380c941f644a794f51e1f575faf00. Resources: {'cores', 'ram', 'instances'} {{(pid=120441) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 01:55:34.523787 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-e28568d8-c7e5-45c9-9260-e6e6629d221a tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Going to run 1 instances... {{(pid=120441) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 01:55:34.526407 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-e28568d8-c7e5-45c9-9260-e6e6629d221a tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] [instance: 8e27bc37-d7c8-4048-a910-5c6a207c9422] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1546da04-912c-44c6-b4b9-34fba35e08f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120441) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 01:55:34.553451 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-1daa7ef3-db9e-46e0-adb5-3ab03ea7abdb tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:34.570936 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-1daa7ef3-db9e-46e0-adb5-3ab03ea7abdb tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1520 microversion: 2.1 time: 0.186146 Sep 16 01:55:34.571524 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 129/273] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:34 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1520 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:34.588575 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-e28568d8-c7e5-45c9-9260-e6e6629d221a tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.602949 Sep 16 01:55:34.589736 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 145/274] 10.222.0.42 () {60 vars in 1147 bytes} [Fri Sep 16 01:55:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 01:55:34.602088 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-b7d960c4-3045-46ba-bfbe-04a4aa4040ed tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:34.602739 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-b7d960c4-3045-46ba-bfbe-04a4aa4040ed tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] [instance: 8e27bc37-d7c8-4048-a910-5c6a207c9422] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:34.666291 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-b7d960c4-3045-46ba-bfbe-04a4aa4040ed tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a422989ce94168a042135234bea46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0380c941f644a794f51e1f575faf00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:34.679406 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-b7d960c4-3045-46ba-bfbe-04a4aa4040ed tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] 10.222.0.42 "GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422" status: 200 len: 1213 microversion: 2.1 time: 0.083059 Sep 16 01:55:34.679996 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 130/275] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:34 2022] GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422 => generated 1213 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:35.597974 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-11861303-c0d8-4f20-965c-3d5c7d6556da tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:35.598699 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-11861303-c0d8-4f20-965c-3d5c7d6556da tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:35.604894 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-11861303-c0d8-4f20-965c-3d5c7d6556da tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:35.605382 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-11861303-c0d8-4f20-965c-3d5c7d6556da tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:35.605821 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-11861303-c0d8-4f20-965c-3d5c7d6556da tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:35.606510 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-11861303-c0d8-4f20-965c-3d5c7d6556da tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:35.606963 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-11861303-c0d8-4f20-965c-3d5c7d6556da tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:35.607391 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-11861303-c0d8-4f20-965c-3d5c7d6556da tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:35.702180 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-109e8098-df57-42ba-90a7-eb58b179b28b tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:35.703052 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-109e8098-df57-42ba-90a7-eb58b179b28b tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] [instance: 8e27bc37-d7c8-4048-a910-5c6a207c9422] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:35.710444 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-109e8098-df57-42ba-90a7-eb58b179b28b tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:35.711023 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-109e8098-df57-42ba-90a7-eb58b179b28b tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:35.711546 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-109e8098-df57-42ba-90a7-eb58b179b28b tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:35.712348 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-109e8098-df57-42ba-90a7-eb58b179b28b tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:35.712950 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-109e8098-df57-42ba-90a7-eb58b179b28b tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:35.714220 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-109e8098-df57-42ba-90a7-eb58b179b28b tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:35.751522 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-11861303-c0d8-4f20-965c-3d5c7d6556da tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:35.760934 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-11861303-c0d8-4f20-965c-3d5c7d6556da tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1520 microversion: 2.1 time: 0.167434 Sep 16 01:55:35.761978 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 146/276] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:35 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1520 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:35.786415 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-109e8098-df57-42ba-90a7-eb58b179b28b tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a422989ce94168a042135234bea46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0380c941f644a794f51e1f575faf00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:35.794945 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-109e8098-df57-42ba-90a7-eb58b179b28b tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] 10.222.0.42 "GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422" status: 200 len: 1265 microversion: 2.1 time: 0.096624 Sep 16 01:55:35.795676 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 131/277] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:35 2022] GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422 => generated 1265 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 01:55:36.784012 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-9c789ed6-80a2-42a8-9090-f3f4d1b326f5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:36.784892 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-9c789ed6-80a2-42a8-9090-f3f4d1b326f5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:36.790727 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9c789ed6-80a2-42a8-9090-f3f4d1b326f5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:36.791209 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9c789ed6-80a2-42a8-9090-f3f4d1b326f5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:36.791642 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9c789ed6-80a2-42a8-9090-f3f4d1b326f5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:36.792372 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9c789ed6-80a2-42a8-9090-f3f4d1b326f5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:36.792824 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9c789ed6-80a2-42a8-9090-f3f4d1b326f5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:36.793246 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9c789ed6-80a2-42a8-9090-f3f4d1b326f5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:36.819151 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-e6692130-2411-4b8e-b6d2-f40cdb640844 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:36.820520 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-e6692130-2411-4b8e-b6d2-f40cdb640844 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] [instance: 8e27bc37-d7c8-4048-a910-5c6a207c9422] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:36.828526 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e6692130-2411-4b8e-b6d2-f40cdb640844 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:36.829002 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e6692130-2411-4b8e-b6d2-f40cdb640844 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:36.829942 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e6692130-2411-4b8e-b6d2-f40cdb640844 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:36.830639 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e6692130-2411-4b8e-b6d2-f40cdb640844 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:36.831238 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e6692130-2411-4b8e-b6d2-f40cdb640844 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:36.831657 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e6692130-2411-4b8e-b6d2-f40cdb640844 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:36.963765 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-e6692130-2411-4b8e-b6d2-f40cdb640844 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a422989ce94168a042135234bea46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0380c941f644a794f51e1f575faf00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:36.971555 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-e6692130-2411-4b8e-b6d2-f40cdb640844 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] 10.222.0.42 "GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422" status: 200 len: 1313 microversion: 2.1 time: 0.156857 Sep 16 01:55:36.973043 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 132/278] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:36 2022] GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 01:55:37.041690 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-9c789ed6-80a2-42a8-9090-f3f4d1b326f5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:37.049791 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-9c789ed6-80a2-42a8-9090-f3f4d1b326f5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1520 microversion: 2.1 time: 0.269562 Sep 16 01:55:37.050478 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 147/279] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:36 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1520 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:37.505582 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [req-43e7ddb3-b4ae-46b0-821f-44a50790f99a req-80ae9e46-9dfb-4d75-b25d-06f5bdfccd04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e27bc37-d7c8-4048-a910-5c6a207c9422", "tag": "f705eaeb-9eb6-4a83-8d43-7f677a7a873e"}]} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:55:37.515047 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-43e7ddb3-b4ae-46b0-821f-44a50790f99a req-80ae9e46-9dfb-4d75-b25d-06f5bdfccd04 service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:37.515524 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-43e7ddb3-b4ae-46b0-821f-44a50790f99a req-80ae9e46-9dfb-4d75-b25d-06f5bdfccd04 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:37.515976 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-43e7ddb3-b4ae-46b0-821f-44a50790f99a req-80ae9e46-9dfb-4d75-b25d-06f5bdfccd04 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:37.527193 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.compute.server_external_events [req-43e7ddb3-b4ae-46b0-821f-44a50790f99a req-80ae9e46-9dfb-4d75-b25d-06f5bdfccd04 service nova] Creating event network-changed:f705eaeb-9eb6-4a83-8d43-7f677a7a873e for instance 8e27bc37-d7c8-4048-a910-5c6a207c9422 on hv-cinder-84914 Sep 16 01:55:37.533371 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [req-43e7ddb3-b4ae-46b0-821f-44a50790f99a req-80ae9e46-9dfb-4d75-b25d-06f5bdfccd04 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032738 Sep 16 01:55:37.534018 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 133/280] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 01:55:37 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 01:55:37.994571 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-597cdad3-875a-4f86-8e93-e44f1a17f0c9 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:37.995085 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-597cdad3-875a-4f86-8e93-e44f1a17f0c9 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] [instance: 8e27bc37-d7c8-4048-a910-5c6a207c9422] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:38.000922 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-597cdad3-875a-4f86-8e93-e44f1a17f0c9 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:38.001398 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-597cdad3-875a-4f86-8e93-e44f1a17f0c9 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:38.001821 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-597cdad3-875a-4f86-8e93-e44f1a17f0c9 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:38.002493 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-597cdad3-875a-4f86-8e93-e44f1a17f0c9 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:38.003664 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-597cdad3-875a-4f86-8e93-e44f1a17f0c9 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:38.004528 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-597cdad3-875a-4f86-8e93-e44f1a17f0c9 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:38.073839 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-f5e8521e-d9d2-415d-ab71-f8d223d1f259 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:38.074564 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-f5e8521e-d9d2-415d-ab71-f8d223d1f259 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:38.081975 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f5e8521e-d9d2-415d-ab71-f8d223d1f259 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:38.082474 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f5e8521e-d9d2-415d-ab71-f8d223d1f259 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:38.082900 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f5e8521e-d9d2-415d-ab71-f8d223d1f259 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:38.083597 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f5e8521e-d9d2-415d-ab71-f8d223d1f259 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:38.084087 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f5e8521e-d9d2-415d-ab71-f8d223d1f259 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:38.084514 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f5e8521e-d9d2-415d-ab71-f8d223d1f259 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:38.142012 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-597cdad3-875a-4f86-8e93-e44f1a17f0c9 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a422989ce94168a042135234bea46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0380c941f644a794f51e1f575faf00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:38.151804 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-597cdad3-875a-4f86-8e93-e44f1a17f0c9 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] 10.222.0.42 "GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422" status: 200 len: 1313 microversion: 2.1 time: 0.160923 Sep 16 01:55:38.152661 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 148/281] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:37 2022] GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422 => generated 1313 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:38.222795 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-f5e8521e-d9d2-415d-ab71-f8d223d1f259 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:38.230396 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-f5e8521e-d9d2-415d-ab71-f8d223d1f259 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1520 microversion: 2.1 time: 0.160794 Sep 16 01:55:38.230975 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 134/282] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:38 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 01:55:39.174317 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-b9c74b8b-d37e-4ee7-96a0-a6e9948854ca tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:39.175925 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-b9c74b8b-d37e-4ee7-96a0-a6e9948854ca tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] [instance: 8e27bc37-d7c8-4048-a910-5c6a207c9422] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:39.181881 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b9c74b8b-d37e-4ee7-96a0-a6e9948854ca tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:39.182380 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b9c74b8b-d37e-4ee7-96a0-a6e9948854ca tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:39.182788 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b9c74b8b-d37e-4ee7-96a0-a6e9948854ca tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:39.183475 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b9c74b8b-d37e-4ee7-96a0-a6e9948854ca tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:39.183923 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b9c74b8b-d37e-4ee7-96a0-a6e9948854ca tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:39.184371 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b9c74b8b-d37e-4ee7-96a0-a6e9948854ca tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:39.254792 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-e11a3a5e-f630-4a4c-a4b9-1c69fdda18f1 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:39.256965 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-e11a3a5e-f630-4a4c-a4b9-1c69fdda18f1 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:39.263642 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e11a3a5e-f630-4a4c-a4b9-1c69fdda18f1 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:39.264218 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e11a3a5e-f630-4a4c-a4b9-1c69fdda18f1 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:39.264660 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e11a3a5e-f630-4a4c-a4b9-1c69fdda18f1 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:39.265504 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e11a3a5e-f630-4a4c-a4b9-1c69fdda18f1 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:39.265967 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e11a3a5e-f630-4a4c-a4b9-1c69fdda18f1 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:39.266402 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e11a3a5e-f630-4a4c-a4b9-1c69fdda18f1 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:39.322455 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-b9c74b8b-d37e-4ee7-96a0-a6e9948854ca tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a422989ce94168a042135234bea46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0380c941f644a794f51e1f575faf00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:39.330591 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-b9c74b8b-d37e-4ee7-96a0-a6e9948854ca tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] 10.222.0.42 "GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422" status: 200 len: 1313 microversion: 2.1 time: 0.160025 Sep 16 01:55:39.331422 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 149/283] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:39 2022] GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422 => generated 1313 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:39.396283 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-e11a3a5e-f630-4a4c-a4b9-1c69fdda18f1 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:39.404042 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-e11a3a5e-f630-4a4c-a4b9-1c69fdda18f1 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1520 microversion: 2.1 time: 0.154552 Sep 16 01:55:39.404610 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 135/284] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:39 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:40.354506 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-a7f9e24b-5792-4dfc-b0eb-add1b2c11a8e tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:40.355108 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-a7f9e24b-5792-4dfc-b0eb-add1b2c11a8e tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] [instance: 8e27bc37-d7c8-4048-a910-5c6a207c9422] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:40.361329 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a7f9e24b-5792-4dfc-b0eb-add1b2c11a8e tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:40.362268 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a7f9e24b-5792-4dfc-b0eb-add1b2c11a8e tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:40.362993 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a7f9e24b-5792-4dfc-b0eb-add1b2c11a8e tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:40.363658 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a7f9e24b-5792-4dfc-b0eb-add1b2c11a8e tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:40.364140 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a7f9e24b-5792-4dfc-b0eb-add1b2c11a8e tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:40.364559 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a7f9e24b-5792-4dfc-b0eb-add1b2c11a8e tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:40.429502 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-193b26c0-ab56-441f-b906-8d81a6fd467b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:40.431541 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-193b26c0-ab56-441f-b906-8d81a6fd467b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:40.446459 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-193b26c0-ab56-441f-b906-8d81a6fd467b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:40.446998 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-193b26c0-ab56-441f-b906-8d81a6fd467b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:40.447482 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-193b26c0-ab56-441f-b906-8d81a6fd467b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:40.448274 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-193b26c0-ab56-441f-b906-8d81a6fd467b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:40.448809 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-193b26c0-ab56-441f-b906-8d81a6fd467b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:40.449244 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-193b26c0-ab56-441f-b906-8d81a6fd467b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:40.520375 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-a7f9e24b-5792-4dfc-b0eb-add1b2c11a8e tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a422989ce94168a042135234bea46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0380c941f644a794f51e1f575faf00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:40.529557 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-a7f9e24b-5792-4dfc-b0eb-add1b2c11a8e tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] 10.222.0.42 "GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422" status: 200 len: 1313 microversion: 2.1 time: 0.178715 Sep 16 01:55:40.530140 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 150/285] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:40 2022] GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422 => generated 1313 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:40.598504 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-193b26c0-ab56-441f-b906-8d81a6fd467b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:40.607467 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-193b26c0-ab56-441f-b906-8d81a6fd467b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1520 microversion: 2.1 time: 0.182277 Sep 16 01:55:40.607988 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 136/286] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:40 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1520 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:41.555676 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-9e4e62e3-9dc0-4b93-8f8b-99878b54bad0 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:41.556316 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-9e4e62e3-9dc0-4b93-8f8b-99878b54bad0 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] [instance: 8e27bc37-d7c8-4048-a910-5c6a207c9422] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:41.562578 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9e4e62e3-9dc0-4b93-8f8b-99878b54bad0 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:41.563064 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9e4e62e3-9dc0-4b93-8f8b-99878b54bad0 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:41.563483 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9e4e62e3-9dc0-4b93-8f8b-99878b54bad0 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:41.564201 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9e4e62e3-9dc0-4b93-8f8b-99878b54bad0 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:41.564648 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9e4e62e3-9dc0-4b93-8f8b-99878b54bad0 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:41.565240 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9e4e62e3-9dc0-4b93-8f8b-99878b54bad0 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:41.631425 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-d56f8211-fcac-4c85-a1b7-dfaa3e290d7c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:41.631860 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-d56f8211-fcac-4c85-a1b7-dfaa3e290d7c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:41.638121 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d56f8211-fcac-4c85-a1b7-dfaa3e290d7c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:41.638611 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d56f8211-fcac-4c85-a1b7-dfaa3e290d7c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:41.639052 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d56f8211-fcac-4c85-a1b7-dfaa3e290d7c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:41.640227 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d56f8211-fcac-4c85-a1b7-dfaa3e290d7c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:41.640686 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d56f8211-fcac-4c85-a1b7-dfaa3e290d7c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:41.641144 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d56f8211-fcac-4c85-a1b7-dfaa3e290d7c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:41.700826 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-9e4e62e3-9dc0-4b93-8f8b-99878b54bad0 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a422989ce94168a042135234bea46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0380c941f644a794f51e1f575faf00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:41.710172 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-9e4e62e3-9dc0-4b93-8f8b-99878b54bad0 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] 10.222.0.42 "GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422" status: 200 len: 1313 microversion: 2.1 time: 0.158304 Sep 16 01:55:41.710751 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 151/287] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:41 2022] GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:41.907192 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-d56f8211-fcac-4c85-a1b7-dfaa3e290d7c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:41.915550 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-d56f8211-fcac-4c85-a1b7-dfaa3e290d7c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1520 microversion: 2.1 time: 0.288640 Sep 16 01:55:41.916140 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 137/288] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:41 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1520 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:42.733838 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-c601f622-46d0-4311-bdf7-ef58155ce9ce tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:42.734419 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-c601f622-46d0-4311-bdf7-ef58155ce9ce tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] [instance: 8e27bc37-d7c8-4048-a910-5c6a207c9422] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:42.740397 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c601f622-46d0-4311-bdf7-ef58155ce9ce tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:42.740881 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c601f622-46d0-4311-bdf7-ef58155ce9ce tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:42.741316 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c601f622-46d0-4311-bdf7-ef58155ce9ce tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:42.741997 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c601f622-46d0-4311-bdf7-ef58155ce9ce tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:42.742444 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c601f622-46d0-4311-bdf7-ef58155ce9ce tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:42.742861 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c601f622-46d0-4311-bdf7-ef58155ce9ce tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:42.875261 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-c601f622-46d0-4311-bdf7-ef58155ce9ce tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a422989ce94168a042135234bea46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0380c941f644a794f51e1f575faf00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:42.883851 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-c601f622-46d0-4311-bdf7-ef58155ce9ce tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] 10.222.0.42 "GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422" status: 200 len: 1313 microversion: 2.1 time: 0.153802 Sep 16 01:55:42.884462 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 152/289] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:42 2022] GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422 => generated 1313 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:42.939460 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-3c71ebee-d5f2-46a2-a13b-300044859260 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:42.940655 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-3c71ebee-d5f2-46a2-a13b-300044859260 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:42.947415 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3c71ebee-d5f2-46a2-a13b-300044859260 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:42.947906 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3c71ebee-d5f2-46a2-a13b-300044859260 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:42.948373 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3c71ebee-d5f2-46a2-a13b-300044859260 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:42.949089 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3c71ebee-d5f2-46a2-a13b-300044859260 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:42.949534 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3c71ebee-d5f2-46a2-a13b-300044859260 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:42.949953 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3c71ebee-d5f2-46a2-a13b-300044859260 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:43.083019 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-3c71ebee-d5f2-46a2-a13b-300044859260 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:43.090652 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-3c71ebee-d5f2-46a2-a13b-300044859260 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1520 microversion: 2.1 time: 0.154999 Sep 16 01:55:43.091207 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 138/290] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:42 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1520 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:43.907002 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-862abdd5-c097-499f-981a-1a459b9071e9 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:43.907541 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-862abdd5-c097-499f-981a-1a459b9071e9 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] [instance: 8e27bc37-d7c8-4048-a910-5c6a207c9422] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:43.914107 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-862abdd5-c097-499f-981a-1a459b9071e9 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:43.914589 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-862abdd5-c097-499f-981a-1a459b9071e9 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:43.915022 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-862abdd5-c097-499f-981a-1a459b9071e9 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:43.915712 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-862abdd5-c097-499f-981a-1a459b9071e9 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:43.916193 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-862abdd5-c097-499f-981a-1a459b9071e9 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:43.916617 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-862abdd5-c097-499f-981a-1a459b9071e9 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:44.044759 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-862abdd5-c097-499f-981a-1a459b9071e9 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a422989ce94168a042135234bea46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0380c941f644a794f51e1f575faf00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:44.054044 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-862abdd5-c097-499f-981a-1a459b9071e9 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] 10.222.0.42 "GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422" status: 200 len: 1313 microversion: 2.1 time: 0.150820 Sep 16 01:55:44.054603 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 153/291] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:43 2022] GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422 => generated 1313 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:44.114170 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-22b5c484-e3df-40ad-bb3a-d4cc6d66acfc tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:44.114786 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-22b5c484-e3df-40ad-bb3a-d4cc6d66acfc tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:44.121273 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-22b5c484-e3df-40ad-bb3a-d4cc6d66acfc tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:44.121755 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-22b5c484-e3df-40ad-bb3a-d4cc6d66acfc tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:44.122392 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-22b5c484-e3df-40ad-bb3a-d4cc6d66acfc tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:44.123086 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-22b5c484-e3df-40ad-bb3a-d4cc6d66acfc tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:44.123539 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-22b5c484-e3df-40ad-bb3a-d4cc6d66acfc tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:44.123990 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-22b5c484-e3df-40ad-bb3a-d4cc6d66acfc tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:44.262061 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-22b5c484-e3df-40ad-bb3a-d4cc6d66acfc tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:44.271319 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-22b5c484-e3df-40ad-bb3a-d4cc6d66acfc tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1520 microversion: 2.1 time: 0.161235 Sep 16 01:55:44.271925 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 139/292] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:44 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:45.076985 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-eadbc1c9-da88-4f71-8023-2224f8c09ce6 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:45.077590 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-eadbc1c9-da88-4f71-8023-2224f8c09ce6 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] [instance: 8e27bc37-d7c8-4048-a910-5c6a207c9422] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:45.079403 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell0:SELECT=2 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:55:45.080119 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell0:SELECT=6 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:55:45.087530 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-eadbc1c9-da88-4f71-8023-2224f8c09ce6 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:45.088471 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-eadbc1c9-da88-4f71-8023-2224f8c09ce6 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:45.089181 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-eadbc1c9-da88-4f71-8023-2224f8c09ce6 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:45.090066 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-eadbc1c9-da88-4f71-8023-2224f8c09ce6 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:45.090895 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-eadbc1c9-da88-4f71-8023-2224f8c09ce6 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:45.091327 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-eadbc1c9-da88-4f71-8023-2224f8c09ce6 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:45.224972 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-eadbc1c9-da88-4f71-8023-2224f8c09ce6 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a422989ce94168a042135234bea46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0380c941f644a794f51e1f575faf00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:45.232519 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-eadbc1c9-da88-4f71-8023-2224f8c09ce6 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] 10.222.0.42 "GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422" status: 200 len: 1313 microversion: 2.1 time: 0.159324 Sep 16 01:55:45.233070 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 154/293] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:45 2022] GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422 => generated 1313 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:45.293738 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-9383897f-e198-48df-9432-db84e62a7898 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:45.294264 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-9383897f-e198-48df-9432-db84e62a7898 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:45.296286 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell0:SELECT=2 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:55:45.302524 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9383897f-e198-48df-9432-db84e62a7898 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:45.303007 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9383897f-e198-48df-9432-db84e62a7898 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:45.303776 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9383897f-e198-48df-9432-db84e62a7898 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:45.304500 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9383897f-e198-48df-9432-db84e62a7898 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:45.304971 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9383897f-e198-48df-9432-db84e62a7898 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:45.305392 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9383897f-e198-48df-9432-db84e62a7898 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:45.434546 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-9383897f-e198-48df-9432-db84e62a7898 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:45.443547 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-9383897f-e198-48df-9432-db84e62a7898 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1520 microversion: 2.1 time: 0.153687 Sep 16 01:55:45.444133 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 140/294] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:45 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1520 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:46.255443 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-96d78377-1e1e-44ab-bfff-b79521bc1fe0 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:46.256260 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-96d78377-1e1e-44ab-bfff-b79521bc1fe0 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] [instance: 8e27bc37-d7c8-4048-a910-5c6a207c9422] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:46.262349 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-96d78377-1e1e-44ab-bfff-b79521bc1fe0 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:46.262830 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-96d78377-1e1e-44ab-bfff-b79521bc1fe0 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:46.263262 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-96d78377-1e1e-44ab-bfff-b79521bc1fe0 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:46.264014 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-96d78377-1e1e-44ab-bfff-b79521bc1fe0 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:46.264651 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-96d78377-1e1e-44ab-bfff-b79521bc1fe0 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:46.265079 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-96d78377-1e1e-44ab-bfff-b79521bc1fe0 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:46.400296 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-96d78377-1e1e-44ab-bfff-b79521bc1fe0 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a422989ce94168a042135234bea46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0380c941f644a794f51e1f575faf00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:46.408372 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-96d78377-1e1e-44ab-bfff-b79521bc1fe0 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] 10.222.0.42 "GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422" status: 200 len: 1313 microversion: 2.1 time: 0.157289 Sep 16 01:55:46.408780 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 155/295] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:46 2022] GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422 => generated 1313 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:46.467105 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-2aaec75c-388c-432a-a49f-8becf5dbe0cd tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:46.467715 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-2aaec75c-388c-432a-a49f-8becf5dbe0cd tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:46.474279 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2aaec75c-388c-432a-a49f-8becf5dbe0cd tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:46.474759 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2aaec75c-388c-432a-a49f-8becf5dbe0cd tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:46.475192 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2aaec75c-388c-432a-a49f-8becf5dbe0cd tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:46.475875 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2aaec75c-388c-432a-a49f-8becf5dbe0cd tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:46.476364 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2aaec75c-388c-432a-a49f-8becf5dbe0cd tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:46.476790 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2aaec75c-388c-432a-a49f-8becf5dbe0cd tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:46.615581 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-2aaec75c-388c-432a-a49f-8becf5dbe0cd tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:46.624026 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-2aaec75c-388c-432a-a49f-8becf5dbe0cd tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1520 microversion: 2.1 time: 0.160714 Sep 16 01:55:46.624593 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 141/296] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:46 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:47.433645 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-ca446144-f9c5-4efe-92ac-fb9c53543bb2 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:47.434266 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-ca446144-f9c5-4efe-92ac-fb9c53543bb2 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] [instance: 8e27bc37-d7c8-4048-a910-5c6a207c9422] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:47.441728 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ca446144-f9c5-4efe-92ac-fb9c53543bb2 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:47.442215 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ca446144-f9c5-4efe-92ac-fb9c53543bb2 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:47.442654 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ca446144-f9c5-4efe-92ac-fb9c53543bb2 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:47.443566 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ca446144-f9c5-4efe-92ac-fb9c53543bb2 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:47.443786 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ca446144-f9c5-4efe-92ac-fb9c53543bb2 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:47.444289 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ca446144-f9c5-4efe-92ac-fb9c53543bb2 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:47.649279 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-0f62f2b1-1f71-4dba-8002-d58fc1d918d7 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:47.650370 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-0f62f2b1-1f71-4dba-8002-d58fc1d918d7 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:47.656888 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0f62f2b1-1f71-4dba-8002-d58fc1d918d7 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:47.657595 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0f62f2b1-1f71-4dba-8002-d58fc1d918d7 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:47.657869 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-ca446144-f9c5-4efe-92ac-fb9c53543bb2 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a422989ce94168a042135234bea46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0380c941f644a794f51e1f575faf00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:47.658456 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0f62f2b1-1f71-4dba-8002-d58fc1d918d7 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:47.660149 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0f62f2b1-1f71-4dba-8002-d58fc1d918d7 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:47.662179 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0f62f2b1-1f71-4dba-8002-d58fc1d918d7 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:47.662848 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0f62f2b1-1f71-4dba-8002-d58fc1d918d7 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:47.666906 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-ca446144-f9c5-4efe-92ac-fb9c53543bb2 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] 10.222.0.42 "GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422" status: 200 len: 1313 microversion: 2.1 time: 0.237164 Sep 16 01:55:47.680966 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 156/297] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:47 2022] GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422 => generated 1313 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:47.802766 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-0f62f2b1-1f71-4dba-8002-d58fc1d918d7 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:47.811206 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-0f62f2b1-1f71-4dba-8002-d58fc1d918d7 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1520 microversion: 2.1 time: 0.165805 Sep 16 01:55:47.812186 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 142/298] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:47 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1520 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:48.694847 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-4785d70c-b5fa-49da-98ef-941bcd60f6af tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:48.695466 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-4785d70c-b5fa-49da-98ef-941bcd60f6af tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] [instance: 8e27bc37-d7c8-4048-a910-5c6a207c9422] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:48.697289 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:55:48.702536 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4785d70c-b5fa-49da-98ef-941bcd60f6af tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:48.703045 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4785d70c-b5fa-49da-98ef-941bcd60f6af tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:48.703478 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4785d70c-b5fa-49da-98ef-941bcd60f6af tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:48.704191 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4785d70c-b5fa-49da-98ef-941bcd60f6af tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:48.704642 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4785d70c-b5fa-49da-98ef-941bcd60f6af tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:48.705063 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4785d70c-b5fa-49da-98ef-941bcd60f6af tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:48.835947 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-d08aab34-8e63-4c71-9070-54e31953c830 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:48.836753 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-d08aab34-8e63-4c71-9070-54e31953c830 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:48.843647 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d08aab34-8e63-4c71-9070-54e31953c830 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:48.844382 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d08aab34-8e63-4c71-9070-54e31953c830 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:48.844776 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d08aab34-8e63-4c71-9070-54e31953c830 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:48.845467 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d08aab34-8e63-4c71-9070-54e31953c830 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:48.846632 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d08aab34-8e63-4c71-9070-54e31953c830 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:48.847133 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d08aab34-8e63-4c71-9070-54e31953c830 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:48.857182 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-4785d70c-b5fa-49da-98ef-941bcd60f6af tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a422989ce94168a042135234bea46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0380c941f644a794f51e1f575faf00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:48.865528 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-4785d70c-b5fa-49da-98ef-941bcd60f6af tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] 10.222.0.42 "GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422" status: 200 len: 1313 microversion: 2.1 time: 0.174801 Sep 16 01:55:48.866607 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 157/299] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:48 2022] GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422 => generated 1313 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:48.987016 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-d08aab34-8e63-4c71-9070-54e31953c830 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:48.995565 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-d08aab34-8e63-4c71-9070-54e31953c830 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1520 microversion: 2.1 time: 0.164003 Sep 16 01:55:48.996165 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 143/300] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:48 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1520 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 01:55:49.890122 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-e0e3b43a-d5cf-4b0f-85b8-4b0a13e04296 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:49.890870 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-e0e3b43a-d5cf-4b0f-85b8-4b0a13e04296 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] [instance: 8e27bc37-d7c8-4048-a910-5c6a207c9422] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:49.897621 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e0e3b43a-d5cf-4b0f-85b8-4b0a13e04296 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:49.898106 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e0e3b43a-d5cf-4b0f-85b8-4b0a13e04296 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:49.898542 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e0e3b43a-d5cf-4b0f-85b8-4b0a13e04296 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:49.899237 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e0e3b43a-d5cf-4b0f-85b8-4b0a13e04296 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:49.899687 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e0e3b43a-d5cf-4b0f-85b8-4b0a13e04296 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:49.900146 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e0e3b43a-d5cf-4b0f-85b8-4b0a13e04296 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:50.019348 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-3f868758-671c-4834-9729-fdfe22c6be8e tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:50.020696 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-3f868758-671c-4834-9729-fdfe22c6be8e tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:50.027424 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3f868758-671c-4834-9729-fdfe22c6be8e tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:50.028205 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3f868758-671c-4834-9729-fdfe22c6be8e tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:50.028644 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3f868758-671c-4834-9729-fdfe22c6be8e tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:50.029331 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3f868758-671c-4834-9729-fdfe22c6be8e tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:50.029774 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3f868758-671c-4834-9729-fdfe22c6be8e tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:50.030360 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3f868758-671c-4834-9729-fdfe22c6be8e tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:50.046463 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-e0e3b43a-d5cf-4b0f-85b8-4b0a13e04296 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a422989ce94168a042135234bea46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0380c941f644a794f51e1f575faf00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:50.054900 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-e0e3b43a-d5cf-4b0f-85b8-4b0a13e04296 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] 10.222.0.42 "GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422" status: 200 len: 1313 microversion: 2.1 time: 0.169024 Sep 16 01:55:50.056045 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 158/301] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:49 2022] GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422 => generated 1313 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:50.187498 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-3f868758-671c-4834-9729-fdfe22c6be8e tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:50.195895 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-3f868758-671c-4834-9729-fdfe22c6be8e tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1520 microversion: 2.1 time: 0.181068 Sep 16 01:55:50.196608 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 144/302] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:50 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1520 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 01:55:50.696413 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [req-d168bb85-5dc9-4889-a6c2-a742ed544735 req-83f89fef-2ab6-4539-916c-2bb52f66daca service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e27bc37-d7c8-4048-a910-5c6a207c9422", "name": "network-vif-plugged", "status": "completed", "tag": "f705eaeb-9eb6-4a83-8d43-7f677a7a873e"}]} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:55:50.707265 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-d168bb85-5dc9-4889-a6c2-a742ed544735 req-83f89fef-2ab6-4539-916c-2bb52f66daca service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:50.708155 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-d168bb85-5dc9-4889-a6c2-a742ed544735 req-83f89fef-2ab6-4539-916c-2bb52f66daca service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:50.708581 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-d168bb85-5dc9-4889-a6c2-a742ed544735 req-83f89fef-2ab6-4539-916c-2bb52f66daca service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:50.725433 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.compute.server_external_events [req-d168bb85-5dc9-4889-a6c2-a742ed544735 req-83f89fef-2ab6-4539-916c-2bb52f66daca service nova] Creating event network-vif-plugged:f705eaeb-9eb6-4a83-8d43-7f677a7a873e for instance 8e27bc37-d7c8-4048-a910-5c6a207c9422 on hv-cinder-84914 Sep 16 01:55:50.733234 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [req-d168bb85-5dc9-4889-a6c2-a742ed544735 req-83f89fef-2ab6-4539-916c-2bb52f66daca service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040485 Sep 16 01:55:50.735889 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 159/303] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 01:55:50 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 01:55:51.080115 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-564697e7-f5c6-45ff-97d1-3e2fc996394b tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:51.081902 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-564697e7-f5c6-45ff-97d1-3e2fc996394b tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] [instance: 8e27bc37-d7c8-4048-a910-5c6a207c9422] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:51.088689 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-564697e7-f5c6-45ff-97d1-3e2fc996394b tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:51.089339 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-564697e7-f5c6-45ff-97d1-3e2fc996394b tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:51.089838 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-564697e7-f5c6-45ff-97d1-3e2fc996394b tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:51.090591 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-564697e7-f5c6-45ff-97d1-3e2fc996394b tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:51.091107 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-564697e7-f5c6-45ff-97d1-3e2fc996394b tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:51.091776 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-564697e7-f5c6-45ff-97d1-3e2fc996394b tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:51.113021 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell1:SELECT=100 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:55:51.222019 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-23abccb6-34b3-4b28-a3f4-6bbdd00e2b1e tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:51.223004 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-23abccb6-34b3-4b28-a3f4-6bbdd00e2b1e tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:51.230023 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-23abccb6-34b3-4b28-a3f4-6bbdd00e2b1e tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:51.230885 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-23abccb6-34b3-4b28-a3f4-6bbdd00e2b1e tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:51.231436 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-564697e7-f5c6-45ff-97d1-3e2fc996394b tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a422989ce94168a042135234bea46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0380c941f644a794f51e1f575faf00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:51.231808 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-23abccb6-34b3-4b28-a3f4-6bbdd00e2b1e tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:51.232845 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-23abccb6-34b3-4b28-a3f4-6bbdd00e2b1e tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:51.233591 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-23abccb6-34b3-4b28-a3f4-6bbdd00e2b1e tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:51.234839 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-23abccb6-34b3-4b28-a3f4-6bbdd00e2b1e tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:51.239589 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-564697e7-f5c6-45ff-97d1-3e2fc996394b tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] 10.222.0.42 "GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422" status: 200 len: 1313 microversion: 2.1 time: 0.164224 Sep 16 01:55:51.254697 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 145/304] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:51 2022] GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422 => generated 1313 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:51.369490 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-23abccb6-34b3-4b28-a3f4-6bbdd00e2b1e tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:51.373154 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell1:SELECT=100 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:55:51.378893 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-23abccb6-34b3-4b28-a3f4-6bbdd00e2b1e tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1520 microversion: 2.1 time: 0.162811 Sep 16 01:55:51.379730 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 160/305] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:51 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1520 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 01:55:52.272279 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-df7d8229-e9b4-4c36-a2a5-4c02f3be0547 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:52.273063 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-df7d8229-e9b4-4c36-a2a5-4c02f3be0547 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] [instance: 8e27bc37-d7c8-4048-a910-5c6a207c9422] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:52.281495 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-df7d8229-e9b4-4c36-a2a5-4c02f3be0547 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:52.282372 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-df7d8229-e9b4-4c36-a2a5-4c02f3be0547 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:52.283070 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-df7d8229-e9b4-4c36-a2a5-4c02f3be0547 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:52.284618 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-df7d8229-e9b4-4c36-a2a5-4c02f3be0547 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:52.285575 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-df7d8229-e9b4-4c36-a2a5-4c02f3be0547 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:52.286074 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-df7d8229-e9b4-4c36-a2a5-4c02f3be0547 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:52.405054 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-6d36d9eb-25f6-40c2-87c6-48bf048e8df9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:52.406465 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-6d36d9eb-25f6-40c2-87c6-48bf048e8df9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:52.413886 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-6d36d9eb-25f6-40c2-87c6-48bf048e8df9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:52.414644 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-6d36d9eb-25f6-40c2-87c6-48bf048e8df9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:52.415406 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-6d36d9eb-25f6-40c2-87c6-48bf048e8df9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:52.416552 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-6d36d9eb-25f6-40c2-87c6-48bf048e8df9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:52.417230 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-6d36d9eb-25f6-40c2-87c6-48bf048e8df9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:52.417859 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-6d36d9eb-25f6-40c2-87c6-48bf048e8df9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:52.441586 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-df7d8229-e9b4-4c36-a2a5-4c02f3be0547 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a422989ce94168a042135234bea46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0380c941f644a794f51e1f575faf00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:52.450484 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-df7d8229-e9b4-4c36-a2a5-4c02f3be0547 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] 10.222.0.42 "GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422" status: 200 len: 1313 microversion: 2.1 time: 0.187944 Sep 16 01:55:52.451063 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 146/306] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:52 2022] GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422 => generated 1313 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:52.597000 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-6d36d9eb-25f6-40c2-87c6-48bf048e8df9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:52.605451 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-6d36d9eb-25f6-40c2-87c6-48bf048e8df9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1520 microversion: 2.1 time: 0.203906 Sep 16 01:55:52.606497 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 161/307] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:52 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1520 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:53.474225 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-69e77cd5-8904-4d46-9661-927c8661a3eb tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:53.475188 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-69e77cd5-8904-4d46-9661-927c8661a3eb tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] [instance: 8e27bc37-d7c8-4048-a910-5c6a207c9422] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:53.482471 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-69e77cd5-8904-4d46-9661-927c8661a3eb tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:53.482937 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-69e77cd5-8904-4d46-9661-927c8661a3eb tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:53.483393 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-69e77cd5-8904-4d46-9661-927c8661a3eb tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:53.484466 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-69e77cd5-8904-4d46-9661-927c8661a3eb tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:53.484992 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-69e77cd5-8904-4d46-9661-927c8661a3eb tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:53.485428 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-69e77cd5-8904-4d46-9661-927c8661a3eb tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:53.629103 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-69e77cd5-8904-4d46-9661-927c8661a3eb tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a422989ce94168a042135234bea46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0380c941f644a794f51e1f575faf00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:53.629723 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-d36a2cb4-e526-4be3-a2ea-113de3ecaa5d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:53.630338 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-d36a2cb4-e526-4be3-a2ea-113de3ecaa5d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:53.637626 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-69e77cd5-8904-4d46-9661-927c8661a3eb tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] 10.222.0.42 "GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422" status: 200 len: 1497 microversion: 2.1 time: 0.168112 Sep 16 01:55:53.637793 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d36a2cb4-e526-4be3-a2ea-113de3ecaa5d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:53.638252 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d36a2cb4-e526-4be3-a2ea-113de3ecaa5d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:53.638956 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d36a2cb4-e526-4be3-a2ea-113de3ecaa5d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:53.639893 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d36a2cb4-e526-4be3-a2ea-113de3ecaa5d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:53.640427 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 147/308] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:53 2022] GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422 => generated 1497 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 01:55:53.640562 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d36a2cb4-e526-4be3-a2ea-113de3ecaa5d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:53.640982 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d36a2cb4-e526-4be3-a2ea-113de3ecaa5d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:53.817345 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-d36a2cb4-e526-4be3-a2ea-113de3ecaa5d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:53.827654 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-d36a2cb4-e526-4be3-a2ea-113de3ecaa5d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1520 microversion: 2.1 time: 0.202396 Sep 16 01:55:53.828584 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 162/309] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:53 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1520 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:54.207083 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-10b2599c-802a-4613-80a6-6b08230c5dd7 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:54.207576 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-10b2599c-802a-4613-80a6-6b08230c5dd7 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] [instance: 8e27bc37-d7c8-4048-a910-5c6a207c9422] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:54.213533 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-10b2599c-802a-4613-80a6-6b08230c5dd7 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:54.214015 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-10b2599c-802a-4613-80a6-6b08230c5dd7 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:54.214448 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-10b2599c-802a-4613-80a6-6b08230c5dd7 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:54.215140 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-10b2599c-802a-4613-80a6-6b08230c5dd7 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:54.215591 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-10b2599c-802a-4613-80a6-6b08230c5dd7 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:54.216035 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-10b2599c-802a-4613-80a6-6b08230c5dd7 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:54.243512 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-10b2599c-802a-4613-80a6-6b08230c5dd7 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] [instance: 8e27bc37-d7c8-4048-a910-5c6a207c9422] Going to try to terminate instance {{(pid=120440) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 01:55:54.329483 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-10b2599c-802a-4613-80a6-6b08230c5dd7 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422" status: 204 len: 0 microversion: 2.1 time: 0.126154 Sep 16 01:55:54.330249 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 148/310] 10.222.0.42 () {58 vars in 1239 bytes} [Fri Sep 16 01:55:54 2022] DELETE /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 01:55:54.338359 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-0815f709-34a1-4137-b2ef-89edecf70feb tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:54.339250 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-0815f709-34a1-4137-b2ef-89edecf70feb tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] [instance: 8e27bc37-d7c8-4048-a910-5c6a207c9422] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:54.345291 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0815f709-34a1-4137-b2ef-89edecf70feb tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:54.345808 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0815f709-34a1-4137-b2ef-89edecf70feb tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:54.346234 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0815f709-34a1-4137-b2ef-89edecf70feb tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:54.347076 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0815f709-34a1-4137-b2ef-89edecf70feb tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:54.347526 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0815f709-34a1-4137-b2ef-89edecf70feb tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:54.348147 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0815f709-34a1-4137-b2ef-89edecf70feb tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:54.490764 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-0815f709-34a1-4137-b2ef-89edecf70feb tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a422989ce94168a042135234bea46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0380c941f644a794f51e1f575faf00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:54.504039 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-0815f709-34a1-4137-b2ef-89edecf70feb tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] 10.222.0.42 "GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422" status: 200 len: 1503 microversion: 2.1 time: 0.169439 Sep 16 01:55:54.504878 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 163/311] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:54 2022] GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422 => generated 1503 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:54.855102 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-3d572c41-d83a-4e3d-ac57-1b43703cc1cc tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:54.855788 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-3d572c41-d83a-4e3d-ac57-1b43703cc1cc tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:54.863726 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3d572c41-d83a-4e3d-ac57-1b43703cc1cc tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:54.864229 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3d572c41-d83a-4e3d-ac57-1b43703cc1cc tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:54.864666 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3d572c41-d83a-4e3d-ac57-1b43703cc1cc tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:54.865348 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3d572c41-d83a-4e3d-ac57-1b43703cc1cc tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:54.865793 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3d572c41-d83a-4e3d-ac57-1b43703cc1cc tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:54.866208 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3d572c41-d83a-4e3d-ac57-1b43703cc1cc tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:55.003167 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-3d572c41-d83a-4e3d-ac57-1b43703cc1cc tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:55.011088 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-3d572c41-d83a-4e3d-ac57-1b43703cc1cc tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1520 microversion: 2.1 time: 0.160221 Sep 16 01:55:55.011653 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 149/312] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:54 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1520 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:55.526388 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-9d428d6c-106d-495e-8517-e586aadc1d11 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:55.526995 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-9d428d6c-106d-495e-8517-e586aadc1d11 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] [instance: 8e27bc37-d7c8-4048-a910-5c6a207c9422] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:55.533000 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9d428d6c-106d-495e-8517-e586aadc1d11 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:55.533687 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9d428d6c-106d-495e-8517-e586aadc1d11 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:55.534123 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9d428d6c-106d-495e-8517-e586aadc1d11 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:55.534805 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9d428d6c-106d-495e-8517-e586aadc1d11 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:55.535252 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9d428d6c-106d-495e-8517-e586aadc1d11 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:55.535673 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9d428d6c-106d-495e-8517-e586aadc1d11 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:55.671876 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-9d428d6c-106d-495e-8517-e586aadc1d11 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a422989ce94168a042135234bea46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0380c941f644a794f51e1f575faf00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:55.680342 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-9d428d6c-106d-495e-8517-e586aadc1d11 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] 10.222.0.42 "GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422" status: 200 len: 1503 microversion: 2.1 time: 0.157753 Sep 16 01:55:55.681091 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 164/313] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:55 2022] GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422 => generated 1503 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:56.035391 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-366f3c64-2347-4932-b0c2-fce6d6e48b26 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:56.036248 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-366f3c64-2347-4932-b0c2-fce6d6e48b26 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:56.043068 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-366f3c64-2347-4932-b0c2-fce6d6e48b26 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:56.043552 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-366f3c64-2347-4932-b0c2-fce6d6e48b26 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:56.044023 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-366f3c64-2347-4932-b0c2-fce6d6e48b26 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:56.044823 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-366f3c64-2347-4932-b0c2-fce6d6e48b26 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:56.045349 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-366f3c64-2347-4932-b0c2-fce6d6e48b26 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:56.045691 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-366f3c64-2347-4932-b0c2-fce6d6e48b26 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:56.181908 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-366f3c64-2347-4932-b0c2-fce6d6e48b26 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:56.190932 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-366f3c64-2347-4932-b0c2-fce6d6e48b26 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1520 microversion: 2.1 time: 0.159932 Sep 16 01:55:56.191504 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 150/314] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:56 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:56.703990 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-fc174aed-415c-46d2-886f-b7299e1220ac tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:56.704606 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-fc174aed-415c-46d2-886f-b7299e1220ac tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] [instance: 8e27bc37-d7c8-4048-a910-5c6a207c9422] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:56.711176 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fc174aed-415c-46d2-886f-b7299e1220ac tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:56.711650 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fc174aed-415c-46d2-886f-b7299e1220ac tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:56.712114 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fc174aed-415c-46d2-886f-b7299e1220ac tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:56.712794 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fc174aed-415c-46d2-886f-b7299e1220ac tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:56.713238 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fc174aed-415c-46d2-886f-b7299e1220ac tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:56.713659 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fc174aed-415c-46d2-886f-b7299e1220ac tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:56.847189 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-fc174aed-415c-46d2-886f-b7299e1220ac tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a422989ce94168a042135234bea46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0380c941f644a794f51e1f575faf00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:56.855103 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-fc174aed-415c-46d2-886f-b7299e1220ac tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] 10.222.0.42 "GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422" status: 200 len: 1503 microversion: 2.1 time: 0.154970 Sep 16 01:55:56.855795 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 165/315] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:56 2022] GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422 => generated 1503 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:57.214241 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-8c33af4e-d407-4c78-9a35-cf9020bf5c1c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:57.214796 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-8c33af4e-d407-4c78-9a35-cf9020bf5c1c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:57.225300 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8c33af4e-d407-4c78-9a35-cf9020bf5c1c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:57.225500 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8c33af4e-d407-4c78-9a35-cf9020bf5c1c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:57.225929 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8c33af4e-d407-4c78-9a35-cf9020bf5c1c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:57.226617 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8c33af4e-d407-4c78-9a35-cf9020bf5c1c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:57.227063 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8c33af4e-d407-4c78-9a35-cf9020bf5c1c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:57.227485 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8c33af4e-d407-4c78-9a35-cf9020bf5c1c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:57.359426 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-8c33af4e-d407-4c78-9a35-cf9020bf5c1c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:57.369943 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-8c33af4e-d407-4c78-9a35-cf9020bf5c1c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1520 microversion: 2.1 time: 0.159525 Sep 16 01:55:57.370802 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 151/316] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:57 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1520 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:57.879572 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-ed0e1579-53c6-424d-9552-12652df3651d tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:57.880222 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-ed0e1579-53c6-424d-9552-12652df3651d tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] [instance: 8e27bc37-d7c8-4048-a910-5c6a207c9422] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:57.886217 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ed0e1579-53c6-424d-9552-12652df3651d tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:57.886702 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ed0e1579-53c6-424d-9552-12652df3651d tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:57.887138 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ed0e1579-53c6-424d-9552-12652df3651d tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:57.887831 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ed0e1579-53c6-424d-9552-12652df3651d tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:57.888434 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ed0e1579-53c6-424d-9552-12652df3651d tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:57.888860 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ed0e1579-53c6-424d-9552-12652df3651d tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:58.046906 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-ed0e1579-53c6-424d-9552-12652df3651d tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a422989ce94168a042135234bea46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0380c941f644a794f51e1f575faf00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:58.055733 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-ed0e1579-53c6-424d-9552-12652df3651d tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] 10.222.0.42 "GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422" status: 200 len: 1503 microversion: 2.1 time: 0.181035 Sep 16 01:55:58.056495 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 166/317] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:57 2022] GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422 => generated 1503 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:58.393044 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-61b46093-a5c4-4de1-ab3a-70c944931038 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:58.393817 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-61b46093-a5c4-4de1-ab3a-70c944931038 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:58.397382 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:55:58.403770 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-61b46093-a5c4-4de1-ab3a-70c944931038 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:58.404295 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-61b46093-a5c4-4de1-ab3a-70c944931038 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:58.404757 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-61b46093-a5c4-4de1-ab3a-70c944931038 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:58.405396 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-61b46093-a5c4-4de1-ab3a-70c944931038 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:58.405842 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-61b46093-a5c4-4de1-ab3a-70c944931038 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:58.406461 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-61b46093-a5c4-4de1-ab3a-70c944931038 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:58.550017 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-61b46093-a5c4-4de1-ab3a-70c944931038 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:58.557867 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-61b46093-a5c4-4de1-ab3a-70c944931038 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1520 microversion: 2.1 time: 0.168792 Sep 16 01:55:58.558436 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 152/318] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:58 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1520 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 01:55:59.080886 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-95d67ebb-c59a-43bd-baf7-934ddbbdd548 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:59.081688 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-95d67ebb-c59a-43bd-baf7-934ddbbdd548 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] [instance: 8e27bc37-d7c8-4048-a910-5c6a207c9422] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:59.087578 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-95d67ebb-c59a-43bd-baf7-934ddbbdd548 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:59.088148 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-95d67ebb-c59a-43bd-baf7-934ddbbdd548 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:59.088578 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-95d67ebb-c59a-43bd-baf7-934ddbbdd548 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:59.089408 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-95d67ebb-c59a-43bd-baf7-934ddbbdd548 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:59.089939 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-95d67ebb-c59a-43bd-baf7-934ddbbdd548 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:59.090402 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-95d67ebb-c59a-43bd-baf7-934ddbbdd548 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:59.224014 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-95d67ebb-c59a-43bd-baf7-934ddbbdd548 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a422989ce94168a042135234bea46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0380c941f644a794f51e1f575faf00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:59.232192 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-95d67ebb-c59a-43bd-baf7-934ddbbdd548 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] 10.222.0.42 "GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422" status: 200 len: 1503 microversion: 2.1 time: 0.156275 Sep 16 01:55:59.232841 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 167/319] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:59 2022] GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422 => generated 1503 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:55:59.580511 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-ea7913c9-d89c-4cd6-a6ae-dcb546f2b6f9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:55:59.581124 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-ea7913c9-d89c-4cd6-a6ae-dcb546f2b6f9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:55:59.587583 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ea7913c9-d89c-4cd6-a6ae-dcb546f2b6f9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:59.588109 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ea7913c9-d89c-4cd6-a6ae-dcb546f2b6f9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:59.588587 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ea7913c9-d89c-4cd6-a6ae-dcb546f2b6f9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:59.589278 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ea7913c9-d89c-4cd6-a6ae-dcb546f2b6f9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:55:59.589735 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ea7913c9-d89c-4cd6-a6ae-dcb546f2b6f9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:55:59.590166 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ea7913c9-d89c-4cd6-a6ae-dcb546f2b6f9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:55:59.718190 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-ea7913c9-d89c-4cd6-a6ae-dcb546f2b6f9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:55:59.726400 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-ea7913c9-d89c-4cd6-a6ae-dcb546f2b6f9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1520 microversion: 2.1 time: 0.149829 Sep 16 01:55:59.726970 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 153/320] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:55:59 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:00.257112 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-07ae1ec1-950c-4fa7-bec0-eef1f98ee726 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:00.257701 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-07ae1ec1-950c-4fa7-bec0-eef1f98ee726 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] [instance: 8e27bc37-d7c8-4048-a910-5c6a207c9422] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:00.264349 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-07ae1ec1-950c-4fa7-bec0-eef1f98ee726 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:00.264858 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-07ae1ec1-950c-4fa7-bec0-eef1f98ee726 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:00.265290 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-07ae1ec1-950c-4fa7-bec0-eef1f98ee726 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:00.266006 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-07ae1ec1-950c-4fa7-bec0-eef1f98ee726 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:00.266456 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-07ae1ec1-950c-4fa7-bec0-eef1f98ee726 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:00.266903 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-07ae1ec1-950c-4fa7-bec0-eef1f98ee726 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:00.437828 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-07ae1ec1-950c-4fa7-bec0-eef1f98ee726 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a422989ce94168a042135234bea46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0380c941f644a794f51e1f575faf00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:00.446143 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-07ae1ec1-950c-4fa7-bec0-eef1f98ee726 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] 10.222.0.42 "GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422" status: 200 len: 1503 microversion: 2.1 time: 0.193214 Sep 16 01:56:00.446704 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 168/321] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:00 2022] GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422 => generated 1503 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:00.750022 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-f6054e17-f65f-4437-838a-dc8a78d15a36 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:00.750785 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-f6054e17-f65f-4437-838a-dc8a78d15a36 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:00.757862 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f6054e17-f65f-4437-838a-dc8a78d15a36 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:00.758540 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f6054e17-f65f-4437-838a-dc8a78d15a36 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:00.758968 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f6054e17-f65f-4437-838a-dc8a78d15a36 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:00.759647 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f6054e17-f65f-4437-838a-dc8a78d15a36 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:00.760136 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f6054e17-f65f-4437-838a-dc8a78d15a36 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:00.760582 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f6054e17-f65f-4437-838a-dc8a78d15a36 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:00.860137 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [req-1b972757-d0f8-4d6b-b54e-385c96860ffe req-f3933d5b-c77a-438f-bbee-e628cbfa7754 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e27bc37-d7c8-4048-a910-5c6a207c9422", "name": "network-vif-deleted", "tag": "f705eaeb-9eb6-4a83-8d43-7f677a7a873e"}]} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:56:00.869972 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-1b972757-d0f8-4d6b-b54e-385c96860ffe req-f3933d5b-c77a-438f-bbee-e628cbfa7754 service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:00.870370 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-1b972757-d0f8-4d6b-b54e-385c96860ffe req-f3933d5b-c77a-438f-bbee-e628cbfa7754 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:00.870795 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-1b972757-d0f8-4d6b-b54e-385c96860ffe req-f3933d5b-c77a-438f-bbee-e628cbfa7754 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:00.882299 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.compute.server_external_events [req-1b972757-d0f8-4d6b-b54e-385c96860ffe req-f3933d5b-c77a-438f-bbee-e628cbfa7754 service nova] Creating event network-vif-deleted:f705eaeb-9eb6-4a83-8d43-7f677a7a873e for instance 8e27bc37-d7c8-4048-a910-5c6a207c9422 on hv-cinder-84914 Sep 16 01:56:00.887260 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [req-1b972757-d0f8-4d6b-b54e-385c96860ffe req-f3933d5b-c77a-438f-bbee-e628cbfa7754 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030752 Sep 16 01:56:00.887849 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 169/322] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 01:56:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 01:56:00.912962 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-f6054e17-f65f-4437-838a-dc8a78d15a36 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:00.920457 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-f6054e17-f65f-4437-838a-dc8a78d15a36 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1520 microversion: 2.1 time: 0.174306 Sep 16 01:56:00.921004 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 154/323] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:00 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1520 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:01.470598 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-a4d16278-f2b8-4ceb-a626-9c6c1fa3d876 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:01.471299 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-a4d16278-f2b8-4ceb-a626-9c6c1fa3d876 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] [instance: 8e27bc37-d7c8-4048-a910-5c6a207c9422] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:01.478399 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a4d16278-f2b8-4ceb-a626-9c6c1fa3d876 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:01.478881 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a4d16278-f2b8-4ceb-a626-9c6c1fa3d876 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:01.479330 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a4d16278-f2b8-4ceb-a626-9c6c1fa3d876 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:01.480050 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a4d16278-f2b8-4ceb-a626-9c6c1fa3d876 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:01.480502 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a4d16278-f2b8-4ceb-a626-9c6c1fa3d876 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:01.480922 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a4d16278-f2b8-4ceb-a626-9c6c1fa3d876 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:01.546232 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-a4d16278-f2b8-4ceb-a626-9c6c1fa3d876 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a422989ce94168a042135234bea46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0380c941f644a794f51e1f575faf00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:01.554288 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-a4d16278-f2b8-4ceb-a626-9c6c1fa3d876 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] 10.222.0.42 "GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422" status: 200 len: 1461 microversion: 2.1 time: 0.088053 Sep 16 01:56:01.554838 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 170/324] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:01 2022] GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422 => generated 1461 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:01.943386 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-6428cc7f-d5af-4454-86cf-19b51a705d11 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:01.944017 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-6428cc7f-d5af-4454-86cf-19b51a705d11 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:01.950395 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6428cc7f-d5af-4454-86cf-19b51a705d11 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:01.950873 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6428cc7f-d5af-4454-86cf-19b51a705d11 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:01.951307 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6428cc7f-d5af-4454-86cf-19b51a705d11 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:01.952021 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6428cc7f-d5af-4454-86cf-19b51a705d11 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:01.952481 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6428cc7f-d5af-4454-86cf-19b51a705d11 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:01.952909 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6428cc7f-d5af-4454-86cf-19b51a705d11 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:02.078225 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-6428cc7f-d5af-4454-86cf-19b51a705d11 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:02.085808 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-6428cc7f-d5af-4454-86cf-19b51a705d11 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1520 microversion: 2.1 time: 0.146296 Sep 16 01:56:02.086374 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 155/325] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:01 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1520 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:02.577892 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-ccbcf330-e519-4982-b22d-5b9024ab5ca0 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:02.578507 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-ccbcf330-e519-4982-b22d-5b9024ab5ca0 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] [instance: 8e27bc37-d7c8-4048-a910-5c6a207c9422] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:02.584975 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ccbcf330-e519-4982-b22d-5b9024ab5ca0 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:02.585394 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ccbcf330-e519-4982-b22d-5b9024ab5ca0 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:02.585823 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ccbcf330-e519-4982-b22d-5b9024ab5ca0 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:02.586498 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ccbcf330-e519-4982-b22d-5b9024ab5ca0 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:02.586950 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ccbcf330-e519-4982-b22d-5b9024ab5ca0 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:02.587365 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ccbcf330-e519-4982-b22d-5b9024ab5ca0 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:02.647781 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-ccbcf330-e519-4982-b22d-5b9024ab5ca0 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a422989ce94168a042135234bea46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0380c941f644a794f51e1f575faf00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:02.655221 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-ccbcf330-e519-4982-b22d-5b9024ab5ca0 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] 10.222.0.42 "GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422" status: 200 len: 1461 microversion: 2.1 time: 0.081212 Sep 16 01:56:02.655764 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 171/326] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:02 2022] GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422 => generated 1461 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:03.109189 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-93d68036-e1e1-455f-8fc5-15aaa72291ae tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:03.109835 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-93d68036-e1e1-455f-8fc5-15aaa72291ae tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:03.116189 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-93d68036-e1e1-455f-8fc5-15aaa72291ae tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:03.116672 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-93d68036-e1e1-455f-8fc5-15aaa72291ae tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:03.117109 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-93d68036-e1e1-455f-8fc5-15aaa72291ae tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:03.117791 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-93d68036-e1e1-455f-8fc5-15aaa72291ae tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:03.118242 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-93d68036-e1e1-455f-8fc5-15aaa72291ae tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:03.118666 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-93d68036-e1e1-455f-8fc5-15aaa72291ae tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:03.244443 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-93d68036-e1e1-455f-8fc5-15aaa72291ae tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:03.252660 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-93d68036-e1e1-455f-8fc5-15aaa72291ae tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1520 microversion: 2.1 time: 0.147017 Sep 16 01:56:03.253218 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 156/327] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:03 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1520 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:03.678735 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-015de513-e077-4e05-a6d8-12b477e42da9 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:03.679349 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-015de513-e077-4e05-a6d8-12b477e42da9 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] [instance: 8e27bc37-d7c8-4048-a910-5c6a207c9422] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:03.685329 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-015de513-e077-4e05-a6d8-12b477e42da9 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:03.685809 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-015de513-e077-4e05-a6d8-12b477e42da9 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:03.686239 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-015de513-e077-4e05-a6d8-12b477e42da9 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:03.686952 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-015de513-e077-4e05-a6d8-12b477e42da9 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:03.687398 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-015de513-e077-4e05-a6d8-12b477e42da9 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:03.687819 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-015de513-e077-4e05-a6d8-12b477e42da9 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:03.748613 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-015de513-e077-4e05-a6d8-12b477e42da9 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a422989ce94168a042135234bea46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0380c941f644a794f51e1f575faf00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:03.757319 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-015de513-e077-4e05-a6d8-12b477e42da9 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] 10.222.0.42 "GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422" status: 200 len: 1461 microversion: 2.1 time: 0.082470 Sep 16 01:56:03.757866 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 172/328] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:03 2022] GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422 => generated 1461 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:04.274615 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-d3113032-3f1c-4ca8-ac49-eeb8bc0af3ff tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:04.275227 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-d3113032-3f1c-4ca8-ac49-eeb8bc0af3ff tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:04.281729 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d3113032-3f1c-4ca8-ac49-eeb8bc0af3ff tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:04.282223 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d3113032-3f1c-4ca8-ac49-eeb8bc0af3ff tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:04.282645 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d3113032-3f1c-4ca8-ac49-eeb8bc0af3ff tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:04.284017 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d3113032-3f1c-4ca8-ac49-eeb8bc0af3ff tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:04.284476 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d3113032-3f1c-4ca8-ac49-eeb8bc0af3ff tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:04.284893 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d3113032-3f1c-4ca8-ac49-eeb8bc0af3ff tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:04.421475 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-d3113032-3f1c-4ca8-ac49-eeb8bc0af3ff tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:04.429220 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-d3113032-3f1c-4ca8-ac49-eeb8bc0af3ff tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1520 microversion: 2.1 time: 0.158508 Sep 16 01:56:04.429781 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 157/329] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:04 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1520 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:04.780701 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-769324f6-aca3-4b22-8585-698e564482d9 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:04.781318 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-769324f6-aca3-4b22-8585-698e564482d9 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] [instance: 8e27bc37-d7c8-4048-a910-5c6a207c9422] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:04.787195 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-769324f6-aca3-4b22-8585-698e564482d9 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:04.787678 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-769324f6-aca3-4b22-8585-698e564482d9 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:04.788183 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-769324f6-aca3-4b22-8585-698e564482d9 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:04.788870 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-769324f6-aca3-4b22-8585-698e564482d9 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:04.789322 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-769324f6-aca3-4b22-8585-698e564482d9 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:04.789745 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-769324f6-aca3-4b22-8585-698e564482d9 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:04.851318 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-769324f6-aca3-4b22-8585-698e564482d9 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a422989ce94168a042135234bea46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0380c941f644a794f51e1f575faf00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:04.859084 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-769324f6-aca3-4b22-8585-698e564482d9 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] 10.222.0.42 "GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422" status: 200 len: 1461 microversion: 2.1 time: 0.082175 Sep 16 01:56:04.859638 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 173/330] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:04 2022] GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422 => generated 1461 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:05.452120 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-4e9a2879-5905-461a-b6e0-dfeb7d67706f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:05.452739 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-4e9a2879-5905-461a-b6e0-dfeb7d67706f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:05.459652 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-4e9a2879-5905-461a-b6e0-dfeb7d67706f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:05.460191 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-4e9a2879-5905-461a-b6e0-dfeb7d67706f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:05.460658 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-4e9a2879-5905-461a-b6e0-dfeb7d67706f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:05.461342 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-4e9a2879-5905-461a-b6e0-dfeb7d67706f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:05.461793 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-4e9a2879-5905-461a-b6e0-dfeb7d67706f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:05.462214 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-4e9a2879-5905-461a-b6e0-dfeb7d67706f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:05.589511 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-4e9a2879-5905-461a-b6e0-dfeb7d67706f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:05.598441 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-4e9a2879-5905-461a-b6e0-dfeb7d67706f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1520 microversion: 2.1 time: 0.150104 Sep 16 01:56:05.599003 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 158/331] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:05 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:05.883071 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-3cd2aff7-3e14-469d-90e9-d334bb7d3331 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:05.883676 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-3cd2aff7-3e14-469d-90e9-d334bb7d3331 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] [instance: 8e27bc37-d7c8-4048-a910-5c6a207c9422] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:05.889682 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3cd2aff7-3e14-469d-90e9-d334bb7d3331 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:05.890157 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3cd2aff7-3e14-469d-90e9-d334bb7d3331 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:05.890586 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3cd2aff7-3e14-469d-90e9-d334bb7d3331 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:05.891254 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3cd2aff7-3e14-469d-90e9-d334bb7d3331 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:05.891703 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3cd2aff7-3e14-469d-90e9-d334bb7d3331 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:05.892143 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3cd2aff7-3e14-469d-90e9-d334bb7d3331 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:05.954467 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-3cd2aff7-3e14-469d-90e9-d334bb7d3331 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a422989ce94168a042135234bea46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0380c941f644a794f51e1f575faf00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:05.962131 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-3cd2aff7-3e14-469d-90e9-d334bb7d3331 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] 10.222.0.42 "GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422" status: 200 len: 1461 microversion: 2.1 time: 0.083192 Sep 16 01:56:05.962684 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 174/332] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:05 2022] GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422 => generated 1461 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:06.621734 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-48916be6-a736-43cf-9487-d80d68752632 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:06.622343 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-48916be6-a736-43cf-9487-d80d68752632 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:06.629783 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-48916be6-a736-43cf-9487-d80d68752632 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:06.630261 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-48916be6-a736-43cf-9487-d80d68752632 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:06.630696 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-48916be6-a736-43cf-9487-d80d68752632 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:06.631375 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-48916be6-a736-43cf-9487-d80d68752632 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:06.631828 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-48916be6-a736-43cf-9487-d80d68752632 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:06.632278 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-48916be6-a736-43cf-9487-d80d68752632 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:06.761972 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-48916be6-a736-43cf-9487-d80d68752632 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:06.769982 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-48916be6-a736-43cf-9487-d80d68752632 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1520 microversion: 2.1 time: 0.152101 Sep 16 01:56:06.770543 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 159/333] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:06 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:06.987055 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-97952105-babd-456e-8385-2b52d9ddeeeb tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:06.987622 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-97952105-babd-456e-8385-2b52d9ddeeeb tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] [instance: 8e27bc37-d7c8-4048-a910-5c6a207c9422] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:06.993643 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-97952105-babd-456e-8385-2b52d9ddeeeb tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:06.994105 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-97952105-babd-456e-8385-2b52d9ddeeeb tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:06.994539 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-97952105-babd-456e-8385-2b52d9ddeeeb tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:06.995255 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-97952105-babd-456e-8385-2b52d9ddeeeb tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:06.995708 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-97952105-babd-456e-8385-2b52d9ddeeeb tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:06.996162 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-97952105-babd-456e-8385-2b52d9ddeeeb tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:07.055980 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-97952105-babd-456e-8385-2b52d9ddeeeb tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a422989ce94168a042135234bea46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0380c941f644a794f51e1f575faf00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:07.063677 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-97952105-babd-456e-8385-2b52d9ddeeeb tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] 10.222.0.42 "GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422" status: 200 len: 1461 microversion: 2.1 time: 0.081160 Sep 16 01:56:07.064858 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 175/334] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:06 2022] GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422 => generated 1461 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:07.792335 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-2987ec15-ea09-443c-9ec0-4820bbd83a36 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:07.792876 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-2987ec15-ea09-443c-9ec0-4820bbd83a36 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:07.799362 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2987ec15-ea09-443c-9ec0-4820bbd83a36 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:07.799843 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2987ec15-ea09-443c-9ec0-4820bbd83a36 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:07.800315 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2987ec15-ea09-443c-9ec0-4820bbd83a36 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:07.801003 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2987ec15-ea09-443c-9ec0-4820bbd83a36 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:07.801449 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2987ec15-ea09-443c-9ec0-4820bbd83a36 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:07.801868 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2987ec15-ea09-443c-9ec0-4820bbd83a36 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:07.821600 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:56:07.931287 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-2987ec15-ea09-443c-9ec0-4820bbd83a36 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:07.939409 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-2987ec15-ea09-443c-9ec0-4820bbd83a36 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1520 microversion: 2.1 time: 0.150570 Sep 16 01:56:07.940075 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 160/335] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:07 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1520 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:08.088398 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-6fcca02b-2de1-423e-922f-565f07b9168d tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:08.088936 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-6fcca02b-2de1-423e-922f-565f07b9168d tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] [instance: 8e27bc37-d7c8-4048-a910-5c6a207c9422] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:08.094775 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-6fcca02b-2de1-423e-922f-565f07b9168d tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:08.095461 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-6fcca02b-2de1-423e-922f-565f07b9168d tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:08.096246 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-6fcca02b-2de1-423e-922f-565f07b9168d tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:08.096937 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-6fcca02b-2de1-423e-922f-565f07b9168d tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:08.097387 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-6fcca02b-2de1-423e-922f-565f07b9168d tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:08.097810 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-6fcca02b-2de1-423e-922f-565f07b9168d tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:08.159246 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-6fcca02b-2de1-423e-922f-565f07b9168d tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a422989ce94168a042135234bea46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0380c941f644a794f51e1f575faf00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:08.166810 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-6fcca02b-2de1-423e-922f-565f07b9168d tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] 10.222.0.42 "GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422" status: 200 len: 1461 microversion: 2.1 time: 0.082288 Sep 16 01:56:08.167371 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 176/336] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:08 2022] GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422 => generated 1461 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:08.961660 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-a8a51b73-57b1-4014-90d8-d4881c0ee64a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:08.962262 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-a8a51b73-57b1-4014-90d8-d4881c0ee64a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:08.968598 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a8a51b73-57b1-4014-90d8-d4881c0ee64a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:08.969075 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a8a51b73-57b1-4014-90d8-d4881c0ee64a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:08.969500 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a8a51b73-57b1-4014-90d8-d4881c0ee64a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:08.970235 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a8a51b73-57b1-4014-90d8-d4881c0ee64a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:08.970932 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a8a51b73-57b1-4014-90d8-d4881c0ee64a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:08.971350 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a8a51b73-57b1-4014-90d8-d4881c0ee64a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:09.100109 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-a8a51b73-57b1-4014-90d8-d4881c0ee64a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:09.107588 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-a8a51b73-57b1-4014-90d8-d4881c0ee64a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1520 microversion: 2.1 time: 0.149761 Sep 16 01:56:09.108187 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 161/337] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:08 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1520 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:09.189935 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-c3575068-6680-4031-b011-c6d87b6aea2f tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:09.190530 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-c3575068-6680-4031-b011-c6d87b6aea2f tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] [instance: 8e27bc37-d7c8-4048-a910-5c6a207c9422] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:09.196302 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c3575068-6680-4031-b011-c6d87b6aea2f tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:09.196775 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c3575068-6680-4031-b011-c6d87b6aea2f tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:09.197202 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c3575068-6680-4031-b011-c6d87b6aea2f tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:09.197873 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c3575068-6680-4031-b011-c6d87b6aea2f tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:09.198315 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c3575068-6680-4031-b011-c6d87b6aea2f tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:09.198730 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c3575068-6680-4031-b011-c6d87b6aea2f tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:09.259821 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-c3575068-6680-4031-b011-c6d87b6aea2f tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a422989ce94168a042135234bea46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0380c941f644a794f51e1f575faf00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:09.267595 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-c3575068-6680-4031-b011-c6d87b6aea2f tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] 10.222.0.42 "GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422" status: 200 len: 1461 microversion: 2.1 time: 0.082123 Sep 16 01:56:09.268186 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 177/338] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:09 2022] GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422 => generated 1461 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:10.131257 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-e25145e7-88e2-46a1-97dd-6c5a4fc18ac2 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:10.131873 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-e25145e7-88e2-46a1-97dd-6c5a4fc18ac2 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:10.138205 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e25145e7-88e2-46a1-97dd-6c5a4fc18ac2 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:10.138697 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e25145e7-88e2-46a1-97dd-6c5a4fc18ac2 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:10.139135 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e25145e7-88e2-46a1-97dd-6c5a4fc18ac2 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:10.139823 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e25145e7-88e2-46a1-97dd-6c5a4fc18ac2 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:10.140319 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e25145e7-88e2-46a1-97dd-6c5a4fc18ac2 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:10.140749 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e25145e7-88e2-46a1-97dd-6c5a4fc18ac2 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:10.270967 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-e25145e7-88e2-46a1-97dd-6c5a4fc18ac2 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:10.278845 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-e25145e7-88e2-46a1-97dd-6c5a4fc18ac2 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1520 microversion: 2.1 time: 0.152204 Sep 16 01:56:10.279398 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 162/339] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:10 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:10.290354 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-38a80665-f943-4f10-b1f3-4776df3aefd5 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:10.290966 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-38a80665-f943-4f10-b1f3-4776df3aefd5 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] [instance: 8e27bc37-d7c8-4048-a910-5c6a207c9422] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:10.296817 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-38a80665-f943-4f10-b1f3-4776df3aefd5 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:10.297297 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-38a80665-f943-4f10-b1f3-4776df3aefd5 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:10.297732 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-38a80665-f943-4f10-b1f3-4776df3aefd5 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:10.299286 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-38a80665-f943-4f10-b1f3-4776df3aefd5 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:10.299742 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-38a80665-f943-4f10-b1f3-4776df3aefd5 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:10.300194 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-38a80665-f943-4f10-b1f3-4776df3aefd5 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:10.304265 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell1:SELECT=100 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:56:10.364783 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-38a80665-f943-4f10-b1f3-4776df3aefd5 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a422989ce94168a042135234bea46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0380c941f644a794f51e1f575faf00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:10.372526 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-38a80665-f943-4f10-b1f3-4776df3aefd5 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] 10.222.0.42 "GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422" status: 200 len: 1461 microversion: 2.1 time: 0.086037 Sep 16 01:56:10.373282 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 178/340] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:10 2022] GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422 => generated 1461 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:11.303309 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-f2f455f2-8f76-453a-95a2-5769aa615165 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:11.304788 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-f2f455f2-8f76-453a-95a2-5769aa615165 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:11.311715 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f2f455f2-8f76-453a-95a2-5769aa615165 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:11.312244 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f2f455f2-8f76-453a-95a2-5769aa615165 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:11.312678 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f2f455f2-8f76-453a-95a2-5769aa615165 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:11.313378 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f2f455f2-8f76-453a-95a2-5769aa615165 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:11.314498 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f2f455f2-8f76-453a-95a2-5769aa615165 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:11.315059 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f2f455f2-8f76-453a-95a2-5769aa615165 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:11.396346 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-225bfcb8-7f4c-4517-8dce-812e7f9e8ffa tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:11.396897 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-225bfcb8-7f4c-4517-8dce-812e7f9e8ffa tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] [instance: 8e27bc37-d7c8-4048-a910-5c6a207c9422] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:11.413810 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-225bfcb8-7f4c-4517-8dce-812e7f9e8ffa tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:11.414305 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-225bfcb8-7f4c-4517-8dce-812e7f9e8ffa tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:11.414738 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-225bfcb8-7f4c-4517-8dce-812e7f9e8ffa tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:11.415434 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-225bfcb8-7f4c-4517-8dce-812e7f9e8ffa tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:11.415884 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-225bfcb8-7f4c-4517-8dce-812e7f9e8ffa tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:11.416361 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-225bfcb8-7f4c-4517-8dce-812e7f9e8ffa tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:11.464164 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-f2f455f2-8f76-453a-95a2-5769aa615165 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:11.479997 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-f2f455f2-8f76-453a-95a2-5769aa615165 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1520 microversion: 2.1 time: 0.176506 Sep 16 01:56:11.482352 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 163/341] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:11 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1520 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:11.765175 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-225bfcb8-7f4c-4517-8dce-812e7f9e8ffa tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a422989ce94168a042135234bea46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0380c941f644a794f51e1f575faf00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:11.776613 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-225bfcb8-7f4c-4517-8dce-812e7f9e8ffa tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] 10.222.0.42 "GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422" status: 200 len: 1298 microversion: 2.1 time: 0.384434 Sep 16 01:56:11.777943 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 179/342] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:11 2022] GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422 => generated 1298 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 01:56:12.511640 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-bb705ca5-9490-4146-a4fd-491c0d088efd tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:12.512179 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-bb705ca5-9490-4146-a4fd-491c0d088efd tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:12.519306 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bb705ca5-9490-4146-a4fd-491c0d088efd tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:12.520416 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bb705ca5-9490-4146-a4fd-491c0d088efd tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:12.520859 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bb705ca5-9490-4146-a4fd-491c0d088efd tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:12.521546 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bb705ca5-9490-4146-a4fd-491c0d088efd tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:12.522060 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bb705ca5-9490-4146-a4fd-491c0d088efd tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:12.522482 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bb705ca5-9490-4146-a4fd-491c0d088efd tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:12.657952 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-bb705ca5-9490-4146-a4fd-491c0d088efd tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:12.665495 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-bb705ca5-9490-4146-a4fd-491c0d088efd tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1520 microversion: 2.1 time: 0.157881 Sep 16 01:56:12.666056 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 164/343] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:12 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1520 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:12.810866 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-a39c0565-54d7-4fb9-adab-7f4472b73f40 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:12.811319 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-a39c0565-54d7-4fb9-adab-7f4472b73f40 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] [instance: 8e27bc37-d7c8-4048-a910-5c6a207c9422] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:12.818273 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a39c0565-54d7-4fb9-adab-7f4472b73f40 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:12.818754 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a39c0565-54d7-4fb9-adab-7f4472b73f40 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:12.819215 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a39c0565-54d7-4fb9-adab-7f4472b73f40 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:12.819895 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a39c0565-54d7-4fb9-adab-7f4472b73f40 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:12.820382 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a39c0565-54d7-4fb9-adab-7f4472b73f40 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:12.820847 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a39c0565-54d7-4fb9-adab-7f4472b73f40 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:12.850962 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a39c0565-54d7-4fb9-adab-7f4472b73f40 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:12.851431 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a39c0565-54d7-4fb9-adab-7f4472b73f40 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:12.851864 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a39c0565-54d7-4fb9-adab-7f4472b73f40 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:12.852345 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.objects.instance [None req-a39c0565-54d7-4fb9-adab-7f4472b73f40 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lazy-loading 'fault' on Instance uuid 8e27bc37-d7c8-4048-a910-5c6a207c9422 {{(pid=120441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 01:56:12.895903 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-a39c0565-54d7-4fb9-adab-7f4472b73f40 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a422989ce94168a042135234bea46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0380c941f644a794f51e1f575faf00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:12.903383 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-a39c0565-54d7-4fb9-adab-7f4472b73f40 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] 10.222.0.42 "GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422" status: 200 len: 1303 microversion: 2.1 time: 0.096542 Sep 16 01:56:12.903954 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 180/344] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:12 2022] GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422 => generated 1303 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:13.689724 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-5215b1c2-34fe-4f1e-b9da-0759e53b94d9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:13.690487 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-5215b1c2-34fe-4f1e-b9da-0759e53b94d9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:13.697032 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-5215b1c2-34fe-4f1e-b9da-0759e53b94d9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:13.697507 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-5215b1c2-34fe-4f1e-b9da-0759e53b94d9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:13.697967 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-5215b1c2-34fe-4f1e-b9da-0759e53b94d9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:13.698726 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-5215b1c2-34fe-4f1e-b9da-0759e53b94d9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:13.699177 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-5215b1c2-34fe-4f1e-b9da-0759e53b94d9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:13.699597 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-5215b1c2-34fe-4f1e-b9da-0759e53b94d9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:13.828687 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-5215b1c2-34fe-4f1e-b9da-0759e53b94d9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:13.836382 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-5215b1c2-34fe-4f1e-b9da-0759e53b94d9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1520 microversion: 2.1 time: 0.151375 Sep 16 01:56:13.836946 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 165/345] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:13 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1520 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 01:56:13.926898 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-7a87ffee-db2f-46fe-b813-b0c4a822b97b tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:13.927438 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-7a87ffee-db2f-46fe-b813-b0c4a822b97b tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] [instance: 8e27bc37-d7c8-4048-a910-5c6a207c9422] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:13.933404 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7a87ffee-db2f-46fe-b813-b0c4a822b97b tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:13.933885 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7a87ffee-db2f-46fe-b813-b0c4a822b97b tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:13.934331 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7a87ffee-db2f-46fe-b813-b0c4a822b97b tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:13.935023 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7a87ffee-db2f-46fe-b813-b0c4a822b97b tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:13.935470 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7a87ffee-db2f-46fe-b813-b0c4a822b97b tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:13.935887 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7a87ffee-db2f-46fe-b813-b0c4a822b97b tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:13.949702 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.wsgi [None req-7a87ffee-db2f-46fe-b813-b0c4a822b97b tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] HTTP exception thrown: Instance 8e27bc37-d7c8-4048-a910-5c6a207c9422 could not be found. Sep 16 01:56:13.951369 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-7a87ffee-db2f-46fe-b813-b0c4a822b97b tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Request method failure captured: Sep 16 01:56:13.951369 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: request: GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422 HTTP/1.1 Sep 16 01:56:13.951369 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Accept: application/json Sep 16 01:56:13.951369 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Accept-Encoding: identity Sep 16 01:56:13.951369 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Connection: close Sep 16 01:56:13.951369 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Content-Length: 0 Sep 16 01:56:13.951369 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Content-Type: application/json Sep 16 01:56:13.951369 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Host: 10.222.0.42 Sep 16 01:56:13.951369 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Openstack-System-Scope: None Sep 16 01:56:13.951369 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: User-Agent: python-urllib3/1.26.12 Sep 16 01:56:13.951369 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Auth-Token: gAAAAABjI9eTmBRcQ55f471d-zJYvNr88eAp17U512MRuEIRHuh3b1bDTuaAbN6of90Cjdb3-XQoPheamojkhdfX8XSg9SXQk0i_PZwvYAMq32dY9Z_HWgZ187tVv3vfZ6uQOW3c7HNBHSX4OcUplFWfcrn4uPZXx1t5vZWDCHby-IddFGVNP-4 Sep 16 01:56:13.951369 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Domain-Id: None Sep 16 01:56:13.951369 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Domain-Name: None Sep 16 01:56:13.951369 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Identity-Status: Confirmed Sep 16 01:56:13.951369 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Is-Admin-Project: True Sep 16 01:56:13.951369 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Domain-Id: default Sep 16 01:56:13.951369 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Domain-Name: Default Sep 16 01:56:13.951369 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Id: 3a0380c941f644a794f51e1f575faf00 Sep 16 01:56:13.951369 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Name: tempest-VolumesActionsTest-1146828490 Sep 16 01:56:13.951369 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Role: member,reader Sep 16 01:56:13.951369 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Roles: member,reader Sep 16 01:56:13.953229 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3a0380c941f644a794f51e1f575faf00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3a0380c941f644a794f51e1f575faf00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3a0380c941f644a794f51e1f575faf00"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3a0380c941f644a794f51e1f575faf00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 01:56:13.953229 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant: tempest-VolumesActionsTest-1146828490 Sep 16 01:56:13.953229 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant-Id: 3a0380c941f644a794f51e1f575faf00 Sep 16 01:56:13.953229 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant-Name: tempest-VolumesActionsTest-1146828490 Sep 16 01:56:13.953229 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User: tempest-VolumesActionsTest-1146828490-project Sep 16 01:56:13.953229 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Domain-Id: default Sep 16 01:56:13.953229 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Domain-Name: Default Sep 16 01:56:13.953229 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Id: 47a422989ce94168a042135234bea46b Sep 16 01:56:13.953229 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Name: tempest-VolumesActionsTest-1146828490-project Sep 16 01:56:13.953229 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: method: > Sep 16 01:56:13.953229 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: exception: Instance 8e27bc37-d7c8-4048-a910-5c6a207c9422 could not be found. Sep 16 01:56:13.953229 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: action_args: {'id': '8e27bc37-d7c8-4048-a910-5c6a207c9422'} Sep 16 01:56:13.954237 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 01:56:13.954237 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:56:13.954237 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 01:56:13.954237 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 01:56:13.954237 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 01:56:13.954237 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 01:56:13.954237 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 01:56:13.954237 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 01:56:13.954237 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 01:56:13.954237 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 01:56:13.954237 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e27bc37-d7c8-4048-a910-5c6a207c9422 could not be found. Sep 16 01:56:13.954237 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:56:13.954237 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:56:13.954237 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:56:13.954237 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:56:13.954237 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 01:56:13.954237 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 01:56:13.954237 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 01:56:13.954237 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 01:56:13.954237 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 01:56:13.955927 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 01:56:13.955927 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 01:56:13.955927 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 01:56:13.955927 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 01:56:13.955927 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 01:56:13.955927 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 01:56:13.955927 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 01:56:13.955927 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e27bc37-d7c8-4048-a910-5c6a207c9422 could not be found. Sep 16 01:56:13.955927 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:56:13.955927 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:56:13.955927 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:56:13.955927 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:56:13.955927 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 01:56:13.955927 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 01:56:13.955927 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 01:56:13.955927 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 01:56:13.955927 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e27bc37-d7c8-4048-a910-5c6a207c9422 could not be found. Sep 16 01:56:13.955927 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:56:13.957285 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-7a87ffee-db2f-46fe-b813-b0c4a822b97b tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Returning 404 to user: Instance 8e27bc37-d7c8-4048-a910-5c6a207c9422 could not be found. {{(pid=120441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 01:56:13.957285 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-7a87ffee-db2f-46fe-b813-b0c4a822b97b tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] 10.222.0.42 "GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422" status: 404 len: 111 microversion: 2.1 time: 0.030566 Sep 16 01:56:13.957285 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 181/346] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:13 2022] GET /compute/v2.1/servers/8e27bc37-d7c8-4048-a910-5c6a207c9422 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 01:56:14.054027 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-9d78aaf1-320f-4b53-922f-beca9e7edb20 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1558817591", "imageRef": "1546da04-912c-44c6-b4b9-34fba35e08f6", "flavorRef": "452", "networks": [{"uuid": "5464ac9b-c4e0-46ad-93ef-65f3628cf72c"}]}} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:56:14.106376 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.network.neutron [None req-9d78aaf1-320f-4b53-922f-beca9e7edb20 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] validate_networks() for [('5464ac9b-c4e0-46ad-93ef-65f3628cf72c', None, None, None, None, None)] {{(pid=120440) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 01:56:14.461893 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.virt.hardware [None req-9d78aaf1-320f-4b53-922f-beca9e7edb20 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Flavor limits 0:0:0 {{(pid=120440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 01:56:14.462320 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.virt.hardware [None req-9d78aaf1-320f-4b53-922f-beca9e7edb20 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Image limits 0:0:0 {{(pid=120440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 01:56:14.462789 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.virt.hardware [None req-9d78aaf1-320f-4b53-922f-beca9e7edb20 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Flavor pref 0:0:0 {{(pid=120440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 01:56:14.463197 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.virt.hardware [None req-9d78aaf1-320f-4b53-922f-beca9e7edb20 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Image pref 0:0:0 {{(pid=120440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 01:56:14.463608 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.virt.hardware [None req-9d78aaf1-320f-4b53-922f-beca9e7edb20 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 01:56:14.473712 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9d78aaf1-320f-4b53-922f-beca9e7edb20 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:14.474193 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9d78aaf1-320f-4b53-922f-beca9e7edb20 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:14.474631 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9d78aaf1-320f-4b53-922f-beca9e7edb20 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:14.475428 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9d78aaf1-320f-4b53-922f-beca9e7edb20 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:14.475788 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9d78aaf1-320f-4b53-922f-beca9e7edb20 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:14.476253 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9d78aaf1-320f-4b53-922f-beca9e7edb20 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:14.496974 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.quota [None req-9d78aaf1-320f-4b53-922f-beca9e7edb20 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Getting quotas for project 3a0380c941f644a794f51e1f575faf00. Resources: {'cores', 'ram', 'instances'} {{(pid=120440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 01:56:14.501285 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.quota [None req-9d78aaf1-320f-4b53-922f-beca9e7edb20 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Getting quotas for user 47a422989ce94168a042135234bea46b and project 3a0380c941f644a794f51e1f575faf00. Resources: {'cores', 'ram', 'instances'} {{(pid=120440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 01:56:14.515159 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-9d78aaf1-320f-4b53-922f-beca9e7edb20 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Going to run 1 instances... {{(pid=120440) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 01:56:14.519194 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-9d78aaf1-320f-4b53-922f-beca9e7edb20 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] [instance: 6a242b28-4c02-4ae3-b0b3-9e6df39cad1d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1546da04-912c-44c6-b4b9-34fba35e08f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 01:56:14.568704 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-9d78aaf1-320f-4b53-922f-beca9e7edb20 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.518471 Sep 16 01:56:14.569348 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 166/347] 10.222.0.42 () {60 vars in 1147 bytes} [Fri Sep 16 01:56:14 2022] POST /compute/v2.1/servers => generated 380 bytes in 520 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 01:56:14.584435 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-3bea06a0-7686-4631-931c-6541991621a7 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:14.596216 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-3bea06a0-7686-4631-931c-6541991621a7 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] [instance: 6a242b28-4c02-4ae3-b0b3-9e6df39cad1d] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:14.654435 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-3bea06a0-7686-4631-931c-6541991621a7 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a422989ce94168a042135234bea46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0380c941f644a794f51e1f575faf00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:14.665493 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-3bea06a0-7686-4631-931c-6541991621a7 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] 10.222.0.42 "GET /compute/v2.1/servers/6a242b28-4c02-4ae3-b0b3-9e6df39cad1d" status: 200 len: 1214 microversion: 2.1 time: 0.088368 Sep 16 01:56:14.666088 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 182/348] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:14 2022] GET /compute/v2.1/servers/6a242b28-4c02-4ae3-b0b3-9e6df39cad1d => generated 1214 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:14.860034 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-927d3498-9d5e-4aee-9d03-e951130b5c03 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:14.860713 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-927d3498-9d5e-4aee-9d03-e951130b5c03 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:14.870528 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-927d3498-9d5e-4aee-9d03-e951130b5c03 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:14.871640 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-927d3498-9d5e-4aee-9d03-e951130b5c03 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:14.872646 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-927d3498-9d5e-4aee-9d03-e951130b5c03 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:14.873977 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-927d3498-9d5e-4aee-9d03-e951130b5c03 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:14.874849 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-927d3498-9d5e-4aee-9d03-e951130b5c03 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:14.875647 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-927d3498-9d5e-4aee-9d03-e951130b5c03 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:15.105092 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-927d3498-9d5e-4aee-9d03-e951130b5c03 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:15.114047 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-927d3498-9d5e-4aee-9d03-e951130b5c03 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1500 microversion: 2.1 time: 0.259247 Sep 16 01:56:15.115540 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 167/349] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:14 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1500 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:15.141415 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-3fdf30e5-290e-4ad5-a131-b5adafb2bae6 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:15.142072 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-3fdf30e5-290e-4ad5-a131-b5adafb2bae6 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 48c9b577-5e65-464f-9328-da6dc694277c] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:15.148185 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3fdf30e5-290e-4ad5-a131-b5adafb2bae6 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:15.148671 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3fdf30e5-290e-4ad5-a131-b5adafb2bae6 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:15.149282 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3fdf30e5-290e-4ad5-a131-b5adafb2bae6 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:15.150006 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3fdf30e5-290e-4ad5-a131-b5adafb2bae6 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:15.150459 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3fdf30e5-290e-4ad5-a131-b5adafb2bae6 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:15.151010 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3fdf30e5-290e-4ad5-a131-b5adafb2bae6 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:15.351744 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-3fdf30e5-290e-4ad5-a131-b5adafb2bae6 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:15.359299 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-3fdf30e5-290e-4ad5-a131-b5adafb2bae6 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c" status: 200 len: 1516 microversion: 2.1 time: 0.223902 Sep 16 01:56:15.359861 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 183/350] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:15 2022] GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c => generated 1516 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 01:56:15.688632 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-a0442f82-f4ae-4af0-9fb5-5e28f5729a22 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:15.689253 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-a0442f82-f4ae-4af0-9fb5-5e28f5729a22 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] [instance: 6a242b28-4c02-4ae3-b0b3-9e6df39cad1d] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:15.695686 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a0442f82-f4ae-4af0-9fb5-5e28f5729a22 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:15.696221 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a0442f82-f4ae-4af0-9fb5-5e28f5729a22 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:15.696664 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a0442f82-f4ae-4af0-9fb5-5e28f5729a22 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:15.697356 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a0442f82-f4ae-4af0-9fb5-5e28f5729a22 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:15.699108 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a0442f82-f4ae-4af0-9fb5-5e28f5729a22 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:15.699616 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a0442f82-f4ae-4af0-9fb5-5e28f5729a22 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:15.775702 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-a0442f82-f4ae-4af0-9fb5-5e28f5729a22 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a422989ce94168a042135234bea46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0380c941f644a794f51e1f575faf00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:15.784538 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-a0442f82-f4ae-4af0-9fb5-5e28f5729a22 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] 10.222.0.42 "GET /compute/v2.1/servers/6a242b28-4c02-4ae3-b0b3-9e6df39cad1d" status: 200 len: 1210 microversion: 2.1 time: 0.099696 Sep 16 01:56:15.785119 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 168/351] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:15 2022] GET /compute/v2.1/servers/6a242b28-4c02-4ae3-b0b3-9e6df39cad1d => generated 1210 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:16.808359 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-77c66bb5-376c-490b-ac72-1785ab4ece70 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:16.809037 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-77c66bb5-376c-490b-ac72-1785ab4ece70 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] [instance: 6a242b28-4c02-4ae3-b0b3-9e6df39cad1d] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:16.816120 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-77c66bb5-376c-490b-ac72-1785ab4ece70 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:16.816598 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-77c66bb5-376c-490b-ac72-1785ab4ece70 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:16.817027 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-77c66bb5-376c-490b-ac72-1785ab4ece70 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:16.817733 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-77c66bb5-376c-490b-ac72-1785ab4ece70 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:16.818176 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-77c66bb5-376c-490b-ac72-1785ab4ece70 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:16.818594 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-77c66bb5-376c-490b-ac72-1785ab4ece70 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:16.878180 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-77c66bb5-376c-490b-ac72-1785ab4ece70 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a422989ce94168a042135234bea46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0380c941f644a794f51e1f575faf00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:16.885817 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-77c66bb5-376c-490b-ac72-1785ab4ece70 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] 10.222.0.42 "GET /compute/v2.1/servers/6a242b28-4c02-4ae3-b0b3-9e6df39cad1d" status: 200 len: 1210 microversion: 2.1 time: 0.083072 Sep 16 01:56:16.886345 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 184/352] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:16 2022] GET /compute/v2.1/servers/6a242b28-4c02-4ae3-b0b3-9e6df39cad1d => generated 1210 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 01:56:17.908828 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-7cfe7de1-f222-4b69-9104-fd49fff184b2 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:17.909433 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-7cfe7de1-f222-4b69-9104-fd49fff184b2 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] [instance: 6a242b28-4c02-4ae3-b0b3-9e6df39cad1d] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:17.915738 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7cfe7de1-f222-4b69-9104-fd49fff184b2 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:17.916250 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7cfe7de1-f222-4b69-9104-fd49fff184b2 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:17.916683 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7cfe7de1-f222-4b69-9104-fd49fff184b2 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:17.917359 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7cfe7de1-f222-4b69-9104-fd49fff184b2 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:17.917801 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7cfe7de1-f222-4b69-9104-fd49fff184b2 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:17.918216 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7cfe7de1-f222-4b69-9104-fd49fff184b2 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:17.982291 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-7cfe7de1-f222-4b69-9104-fd49fff184b2 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a422989ce94168a042135234bea46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0380c941f644a794f51e1f575faf00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:17.990051 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-7cfe7de1-f222-4b69-9104-fd49fff184b2 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] 10.222.0.42 "GET /compute/v2.1/servers/6a242b28-4c02-4ae3-b0b3-9e6df39cad1d" status: 200 len: 1210 microversion: 2.1 time: 0.085265 Sep 16 01:56:17.990608 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 169/353] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:17 2022] GET /compute/v2.1/servers/6a242b28-4c02-4ae3-b0b3-9e6df39cad1d => generated 1210 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:19.013566 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-23c97b0a-28f0-455f-a113-bee71641adca tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:19.014170 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-23c97b0a-28f0-455f-a113-bee71641adca tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] [instance: 6a242b28-4c02-4ae3-b0b3-9e6df39cad1d] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:19.016070 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_api:SELECT=60 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:56:19.021654 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-23c97b0a-28f0-455f-a113-bee71641adca tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:19.022136 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-23c97b0a-28f0-455f-a113-bee71641adca tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:19.022569 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-23c97b0a-28f0-455f-a113-bee71641adca tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:19.023252 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-23c97b0a-28f0-455f-a113-bee71641adca tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:19.023700 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-23c97b0a-28f0-455f-a113-bee71641adca tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:19.024148 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-23c97b0a-28f0-455f-a113-bee71641adca tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:19.084813 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-23c97b0a-28f0-455f-a113-bee71641adca tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a422989ce94168a042135234bea46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0380c941f644a794f51e1f575faf00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:19.092263 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-23c97b0a-28f0-455f-a113-bee71641adca tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] 10.222.0.42 "GET /compute/v2.1/servers/6a242b28-4c02-4ae3-b0b3-9e6df39cad1d" status: 200 len: 1210 microversion: 2.1 time: 0.082502 Sep 16 01:56:19.092820 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 185/354] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:19 2022] GET /compute/v2.1/servers/6a242b28-4c02-4ae3-b0b3-9e6df39cad1d => generated 1210 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:20.117923 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-8e5c571d-6863-4e2d-b257-0c0174bb45aa tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:20.118687 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-8e5c571d-6863-4e2d-b257-0c0174bb45aa tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] [instance: 6a242b28-4c02-4ae3-b0b3-9e6df39cad1d] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:20.128226 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8e5c571d-6863-4e2d-b257-0c0174bb45aa tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:20.128573 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8e5c571d-6863-4e2d-b257-0c0174bb45aa tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:20.129259 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8e5c571d-6863-4e2d-b257-0c0174bb45aa tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:20.129957 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8e5c571d-6863-4e2d-b257-0c0174bb45aa tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:20.130400 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8e5c571d-6863-4e2d-b257-0c0174bb45aa tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:20.130986 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8e5c571d-6863-4e2d-b257-0c0174bb45aa tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:20.199652 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-8e5c571d-6863-4e2d-b257-0c0174bb45aa tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a422989ce94168a042135234bea46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0380c941f644a794f51e1f575faf00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:20.208441 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-8e5c571d-6863-4e2d-b257-0c0174bb45aa tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] 10.222.0.42 "GET /compute/v2.1/servers/6a242b28-4c02-4ae3-b0b3-9e6df39cad1d" status: 200 len: 1272 microversion: 2.1 time: 0.095615 Sep 16 01:56:20.211975 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 170/355] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:20 2022] GET /compute/v2.1/servers/6a242b28-4c02-4ae3-b0b3-9e6df39cad1d => generated 1272 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:21.023238 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-5cb5288a-6061-4dbe-a28a-1ca54ef8723f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:56:21.025780 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-5cb5288a-6061-4dbe-a28a-1ca54ef8723f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 48c9b577-5e65-464f-9328-da6dc694277c] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:21.031751 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5cb5288a-6061-4dbe-a28a-1ca54ef8723f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:21.032346 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5cb5288a-6061-4dbe-a28a-1ca54ef8723f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:21.032724 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5cb5288a-6061-4dbe-a28a-1ca54ef8723f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:21.033419 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5cb5288a-6061-4dbe-a28a-1ca54ef8723f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:21.033874 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5cb5288a-6061-4dbe-a28a-1ca54ef8723f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:21.034300 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5cb5288a-6061-4dbe-a28a-1ca54ef8723f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:21.059340 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.objects.instance [None req-5cb5288a-6061-4dbe-a28a-1ca54ef8723f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lazy-loading 'flavor' on Instance uuid 48c9b577-5e65-464f-9328-da6dc694277c {{(pid=120441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 01:56:21.182784 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-5cb5288a-6061-4dbe-a28a-1ca54ef8723f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "POST /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c/action" status: 200 len: 32 microversion: 2.1 time: 0.164738 Sep 16 01:56:21.183647 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 186/356] 10.222.0.42 () {60 vars in 1278 bytes} [Fri Sep 16 01:56:21 2022] POST /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c/action => generated 32 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 16 01:56:21.194015 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-2a541059-9e50-433f-b312-30a012f72faf tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:21.195295 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-2a541059-9e50-433f-b312-30a012f72faf tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 48c9b577-5e65-464f-9328-da6dc694277c] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:21.202522 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2a541059-9e50-433f-b312-30a012f72faf tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:21.203019 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2a541059-9e50-433f-b312-30a012f72faf tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:21.203451 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2a541059-9e50-433f-b312-30a012f72faf tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:21.204771 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2a541059-9e50-433f-b312-30a012f72faf tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:21.205251 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2a541059-9e50-433f-b312-30a012f72faf tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:21.205909 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2a541059-9e50-433f-b312-30a012f72faf tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:21.232668 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-4a46ed04-c18a-4b4a-8c07-d277d63d4a1a tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:21.233759 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-4a46ed04-c18a-4b4a-8c07-d277d63d4a1a tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] [instance: 6a242b28-4c02-4ae3-b0b3-9e6df39cad1d] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:21.387255 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4a46ed04-c18a-4b4a-8c07-d277d63d4a1a tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:21.387735 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4a46ed04-c18a-4b4a-8c07-d277d63d4a1a tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:21.388197 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4a46ed04-c18a-4b4a-8c07-d277d63d4a1a tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:21.388881 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4a46ed04-c18a-4b4a-8c07-d277d63d4a1a tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:21.389520 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4a46ed04-c18a-4b4a-8c07-d277d63d4a1a tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:21.390135 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4a46ed04-c18a-4b4a-8c07-d277d63d4a1a tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:21.391655 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-2a541059-9e50-433f-b312-30a012f72faf tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:21.401699 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-2a541059-9e50-433f-b312-30a012f72faf tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c" status: 200 len: 1522 microversion: 2.1 time: 0.209683 Sep 16 01:56:21.402848 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 171/357] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:21 2022] GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c => generated 1522 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:21.417324 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [req-3147c430-489a-4250-8fad-e4b7bb8a091b req-8e3360be-63c4-4a5d-ad82-da315d17b807 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6a242b28-4c02-4ae3-b0b3-9e6df39cad1d", "tag": "a13f9521-b74b-4b3a-a8a1-20cc50cc9a7e"}]} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:56:21.429651 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-3147c430-489a-4250-8fad-e4b7bb8a091b req-8e3360be-63c4-4a5d-ad82-da315d17b807 service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:21.430160 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-3147c430-489a-4250-8fad-e4b7bb8a091b req-8e3360be-63c4-4a5d-ad82-da315d17b807 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:21.430589 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-3147c430-489a-4250-8fad-e4b7bb8a091b req-8e3360be-63c4-4a5d-ad82-da315d17b807 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:21.445930 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.compute.server_external_events [req-3147c430-489a-4250-8fad-e4b7bb8a091b req-8e3360be-63c4-4a5d-ad82-da315d17b807 service nova] Creating event network-changed:a13f9521-b74b-4b3a-a8a1-20cc50cc9a7e for instance 6a242b28-4c02-4ae3-b0b3-9e6df39cad1d on hv-cinder-84914 Sep 16 01:56:21.451025 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [req-3147c430-489a-4250-8fad-e4b7bb8a091b req-8e3360be-63c4-4a5d-ad82-da315d17b807 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046754 Sep 16 01:56:21.451743 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 172/358] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 01:56:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:56:21.729895 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-4a46ed04-c18a-4b4a-8c07-d277d63d4a1a tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a422989ce94168a042135234bea46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0380c941f644a794f51e1f575faf00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:21.738496 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-4a46ed04-c18a-4b4a-8c07-d277d63d4a1a tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] 10.222.0.42 "GET /compute/v2.1/servers/6a242b28-4c02-4ae3-b0b3-9e6df39cad1d" status: 200 len: 1314 microversion: 2.1 time: 0.510123 Sep 16 01:56:21.739094 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 187/359] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:21 2022] GET /compute/v2.1/servers/6a242b28-4c02-4ae3-b0b3-9e6df39cad1d => generated 1314 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 01:56:22.427964 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-1aff2c80-60a2-4686-a9fa-1c487f809a96 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:22.428686 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-1aff2c80-60a2-4686-a9fa-1c487f809a96 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 48c9b577-5e65-464f-9328-da6dc694277c] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:22.434830 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1aff2c80-60a2-4686-a9fa-1c487f809a96 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:22.435318 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1aff2c80-60a2-4686-a9fa-1c487f809a96 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:22.435753 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1aff2c80-60a2-4686-a9fa-1c487f809a96 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:22.436473 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1aff2c80-60a2-4686-a9fa-1c487f809a96 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:22.436948 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1aff2c80-60a2-4686-a9fa-1c487f809a96 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:22.437373 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1aff2c80-60a2-4686-a9fa-1c487f809a96 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:22.576091 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-1aff2c80-60a2-4686-a9fa-1c487f809a96 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:22.586781 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-1aff2c80-60a2-4686-a9fa-1c487f809a96 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c" status: 200 len: 1522 microversion: 2.1 time: 0.162738 Sep 16 01:56:22.587450 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 173/360] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:22 2022] GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:22.762706 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-933719be-e124-4e00-8d96-0bfd36a30979 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:22.763246 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-933719be-e124-4e00-8d96-0bfd36a30979 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] [instance: 6a242b28-4c02-4ae3-b0b3-9e6df39cad1d] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:22.769059 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-933719be-e124-4e00-8d96-0bfd36a30979 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:22.769534 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-933719be-e124-4e00-8d96-0bfd36a30979 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:22.769961 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-933719be-e124-4e00-8d96-0bfd36a30979 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:22.770642 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-933719be-e124-4e00-8d96-0bfd36a30979 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:22.771084 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-933719be-e124-4e00-8d96-0bfd36a30979 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:22.771496 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-933719be-e124-4e00-8d96-0bfd36a30979 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:22.903876 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-933719be-e124-4e00-8d96-0bfd36a30979 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a422989ce94168a042135234bea46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0380c941f644a794f51e1f575faf00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:22.912552 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-933719be-e124-4e00-8d96-0bfd36a30979 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] 10.222.0.42 "GET /compute/v2.1/servers/6a242b28-4c02-4ae3-b0b3-9e6df39cad1d" status: 200 len: 1314 microversion: 2.1 time: 0.154012 Sep 16 01:56:22.913106 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 188/361] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:22 2022] GET /compute/v2.1/servers/6a242b28-4c02-4ae3-b0b3-9e6df39cad1d => generated 1314 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:23.610519 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-37e5f348-28e4-452a-a87b-8168a37ffa46 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:23.611129 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-37e5f348-28e4-452a-a87b-8168a37ffa46 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 48c9b577-5e65-464f-9328-da6dc694277c] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:23.617431 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-37e5f348-28e4-452a-a87b-8168a37ffa46 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:23.617911 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-37e5f348-28e4-452a-a87b-8168a37ffa46 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:23.618346 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-37e5f348-28e4-452a-a87b-8168a37ffa46 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:23.619024 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-37e5f348-28e4-452a-a87b-8168a37ffa46 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:23.619475 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-37e5f348-28e4-452a-a87b-8168a37ffa46 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:23.619897 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-37e5f348-28e4-452a-a87b-8168a37ffa46 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:23.746280 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-37e5f348-28e4-452a-a87b-8168a37ffa46 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:23.754640 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-37e5f348-28e4-452a-a87b-8168a37ffa46 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c" status: 200 len: 1522 microversion: 2.1 time: 0.148147 Sep 16 01:56:23.755204 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 174/362] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:23 2022] GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:23.935705 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-7d6b6068-221d-4a91-b366-c28e0a332cc9 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:23.936409 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-7d6b6068-221d-4a91-b366-c28e0a332cc9 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] [instance: 6a242b28-4c02-4ae3-b0b3-9e6df39cad1d] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:23.942914 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7d6b6068-221d-4a91-b366-c28e0a332cc9 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:23.943396 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7d6b6068-221d-4a91-b366-c28e0a332cc9 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:23.943835 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7d6b6068-221d-4a91-b366-c28e0a332cc9 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:23.944544 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7d6b6068-221d-4a91-b366-c28e0a332cc9 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:23.945000 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7d6b6068-221d-4a91-b366-c28e0a332cc9 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:23.945426 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7d6b6068-221d-4a91-b366-c28e0a332cc9 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:24.079315 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-7d6b6068-221d-4a91-b366-c28e0a332cc9 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a422989ce94168a042135234bea46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0380c941f644a794f51e1f575faf00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:24.087366 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-7d6b6068-221d-4a91-b366-c28e0a332cc9 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] 10.222.0.42 "GET /compute/v2.1/servers/6a242b28-4c02-4ae3-b0b3-9e6df39cad1d" status: 200 len: 1314 microversion: 2.1 time: 0.155452 Sep 16 01:56:24.087912 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 189/363] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:23 2022] GET /compute/v2.1/servers/6a242b28-4c02-4ae3-b0b3-9e6df39cad1d => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:24.778816 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-64c486f4-99e1-4416-95ca-0497df6638fa tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:24.779340 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-64c486f4-99e1-4416-95ca-0497df6638fa tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 48c9b577-5e65-464f-9328-da6dc694277c] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:24.781395 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell0:SELECT=2 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:56:24.783058 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell0:SELECT=6 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:56:24.789224 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-64c486f4-99e1-4416-95ca-0497df6638fa tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:24.789707 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-64c486f4-99e1-4416-95ca-0497df6638fa tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:24.790136 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-64c486f4-99e1-4416-95ca-0497df6638fa tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:24.790823 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-64c486f4-99e1-4416-95ca-0497df6638fa tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:24.791267 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-64c486f4-99e1-4416-95ca-0497df6638fa tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:24.791687 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-64c486f4-99e1-4416-95ca-0497df6638fa tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:24.966923 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-64c486f4-99e1-4416-95ca-0497df6638fa tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:24.976005 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-64c486f4-99e1-4416-95ca-0497df6638fa tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c" status: 200 len: 1522 microversion: 2.1 time: 0.200615 Sep 16 01:56:24.979734 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 175/364] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:24 2022] GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:25.112180 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-ca8f903c-5b87-44e5-a671-b6acabf3bdfc tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:25.112180 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-ca8f903c-5b87-44e5-a671-b6acabf3bdfc tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] [instance: 6a242b28-4c02-4ae3-b0b3-9e6df39cad1d] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:25.122122 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell0:SELECT=2 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:56:25.127676 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ca8f903c-5b87-44e5-a671-b6acabf3bdfc tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:25.128451 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ca8f903c-5b87-44e5-a671-b6acabf3bdfc tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:25.129551 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ca8f903c-5b87-44e5-a671-b6acabf3bdfc tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:25.130707 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ca8f903c-5b87-44e5-a671-b6acabf3bdfc tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:25.131540 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ca8f903c-5b87-44e5-a671-b6acabf3bdfc tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:25.132421 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ca8f903c-5b87-44e5-a671-b6acabf3bdfc tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:25.362940 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-ca8f903c-5b87-44e5-a671-b6acabf3bdfc tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a422989ce94168a042135234bea46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0380c941f644a794f51e1f575faf00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:25.373143 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-ca8f903c-5b87-44e5-a671-b6acabf3bdfc tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] 10.222.0.42 "GET /compute/v2.1/servers/6a242b28-4c02-4ae3-b0b3-9e6df39cad1d" status: 200 len: 1314 microversion: 2.1 time: 0.266863 Sep 16 01:56:25.374130 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 190/365] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:25 2022] GET /compute/v2.1/servers/6a242b28-4c02-4ae3-b0b3-9e6df39cad1d => generated 1314 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:25.999316 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-d1c6cde0-9813-4eaf-ab0f-521cfd518a59 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:26.001269 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-d1c6cde0-9813-4eaf-ab0f-521cfd518a59 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 48c9b577-5e65-464f-9328-da6dc694277c] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:26.008466 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d1c6cde0-9813-4eaf-ab0f-521cfd518a59 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:26.008952 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d1c6cde0-9813-4eaf-ab0f-521cfd518a59 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:26.009430 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d1c6cde0-9813-4eaf-ab0f-521cfd518a59 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:26.010107 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d1c6cde0-9813-4eaf-ab0f-521cfd518a59 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:26.010554 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d1c6cde0-9813-4eaf-ab0f-521cfd518a59 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:26.010965 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d1c6cde0-9813-4eaf-ab0f-521cfd518a59 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:26.174480 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-d1c6cde0-9813-4eaf-ab0f-521cfd518a59 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:26.183143 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-d1c6cde0-9813-4eaf-ab0f-521cfd518a59 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c" status: 200 len: 1522 microversion: 2.1 time: 0.187709 Sep 16 01:56:26.183728 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 176/366] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:25 2022] GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c => generated 1522 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:26.402481 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-94d7cc81-36e7-4add-90d0-ee6f3b3d713d tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:26.403190 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-94d7cc81-36e7-4add-90d0-ee6f3b3d713d tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] [instance: 6a242b28-4c02-4ae3-b0b3-9e6df39cad1d] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:26.409766 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-94d7cc81-36e7-4add-90d0-ee6f3b3d713d tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:26.410337 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-94d7cc81-36e7-4add-90d0-ee6f3b3d713d tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:26.410841 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-94d7cc81-36e7-4add-90d0-ee6f3b3d713d tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:26.411593 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-94d7cc81-36e7-4add-90d0-ee6f3b3d713d tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:26.412150 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-94d7cc81-36e7-4add-90d0-ee6f3b3d713d tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:26.412640 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-94d7cc81-36e7-4add-90d0-ee6f3b3d713d tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:26.561523 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-94d7cc81-36e7-4add-90d0-ee6f3b3d713d tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a422989ce94168a042135234bea46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0380c941f644a794f51e1f575faf00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:26.576315 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-94d7cc81-36e7-4add-90d0-ee6f3b3d713d tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] 10.222.0.42 "GET /compute/v2.1/servers/6a242b28-4c02-4ae3-b0b3-9e6df39cad1d" status: 200 len: 1314 microversion: 2.1 time: 0.177542 Sep 16 01:56:26.577141 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 191/367] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:26 2022] GET /compute/v2.1/servers/6a242b28-4c02-4ae3-b0b3-9e6df39cad1d => generated 1314 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:27.207077 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-609cc84f-c6e9-4cc0-bd44-2eb18e523e9a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:27.207812 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-609cc84f-c6e9-4cc0-bd44-2eb18e523e9a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 48c9b577-5e65-464f-9328-da6dc694277c] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:27.214174 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-609cc84f-c6e9-4cc0-bd44-2eb18e523e9a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:27.214729 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-609cc84f-c6e9-4cc0-bd44-2eb18e523e9a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:27.215231 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-609cc84f-c6e9-4cc0-bd44-2eb18e523e9a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:27.216004 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-609cc84f-c6e9-4cc0-bd44-2eb18e523e9a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:27.216529 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-609cc84f-c6e9-4cc0-bd44-2eb18e523e9a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:27.217020 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-609cc84f-c6e9-4cc0-bd44-2eb18e523e9a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:27.345750 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-609cc84f-c6e9-4cc0-bd44-2eb18e523e9a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:27.353464 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-609cc84f-c6e9-4cc0-bd44-2eb18e523e9a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c" status: 200 len: 1522 microversion: 2.1 time: 0.150391 Sep 16 01:56:27.354306 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 177/368] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:27 2022] GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:27.552945 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [req-bcef5c09-46bb-4302-8c9f-80fcb98f8cbe req-813b37c0-cee4-4454-8bd0-1396bdc2dc5d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a242b28-4c02-4ae3-b0b3-9e6df39cad1d", "name": "network-vif-plugged", "status": "completed", "tag": "a13f9521-b74b-4b3a-a8a1-20cc50cc9a7e"}]} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:56:27.562666 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-bcef5c09-46bb-4302-8c9f-80fcb98f8cbe req-813b37c0-cee4-4454-8bd0-1396bdc2dc5d service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:27.563543 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-bcef5c09-46bb-4302-8c9f-80fcb98f8cbe req-813b37c0-cee4-4454-8bd0-1396bdc2dc5d service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:27.564250 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-bcef5c09-46bb-4302-8c9f-80fcb98f8cbe req-813b37c0-cee4-4454-8bd0-1396bdc2dc5d service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:27.577184 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.compute.server_external_events [req-bcef5c09-46bb-4302-8c9f-80fcb98f8cbe req-813b37c0-cee4-4454-8bd0-1396bdc2dc5d service nova] Creating event network-vif-plugged:a13f9521-b74b-4b3a-a8a1-20cc50cc9a7e for instance 6a242b28-4c02-4ae3-b0b3-9e6df39cad1d on hv-cinder-84914 Sep 16 01:56:27.583213 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [req-bcef5c09-46bb-4302-8c9f-80fcb98f8cbe req-813b37c0-cee4-4454-8bd0-1396bdc2dc5d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033766 Sep 16 01:56:27.583857 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 192/369] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 01:56:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:56:27.601937 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-9051d2ac-9c38-47f9-a0db-88400b6aa638 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:27.603164 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-9051d2ac-9c38-47f9-a0db-88400b6aa638 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] [instance: 6a242b28-4c02-4ae3-b0b3-9e6df39cad1d] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:27.611425 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9051d2ac-9c38-47f9-a0db-88400b6aa638 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:27.611914 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9051d2ac-9c38-47f9-a0db-88400b6aa638 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:27.612376 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9051d2ac-9c38-47f9-a0db-88400b6aa638 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:27.613253 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9051d2ac-9c38-47f9-a0db-88400b6aa638 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:27.613706 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9051d2ac-9c38-47f9-a0db-88400b6aa638 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:27.614130 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9051d2ac-9c38-47f9-a0db-88400b6aa638 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:27.648416 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell1:SELECT=100 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:56:27.766785 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-9051d2ac-9c38-47f9-a0db-88400b6aa638 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a422989ce94168a042135234bea46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0380c941f644a794f51e1f575faf00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:27.774816 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-9051d2ac-9c38-47f9-a0db-88400b6aa638 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] 10.222.0.42 "GET /compute/v2.1/servers/6a242b28-4c02-4ae3-b0b3-9e6df39cad1d" status: 200 len: 1314 microversion: 2.1 time: 0.176903 Sep 16 01:56:27.775377 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 178/370] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:27 2022] GET /compute/v2.1/servers/6a242b28-4c02-4ae3-b0b3-9e6df39cad1d => generated 1314 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:28.378392 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-8a6abeb1-cb23-471f-b9ce-a536d3b51d20 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:28.379336 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-8a6abeb1-cb23-471f-b9ce-a536d3b51d20 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 48c9b577-5e65-464f-9328-da6dc694277c] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:28.385840 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8a6abeb1-cb23-471f-b9ce-a536d3b51d20 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:28.386315 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8a6abeb1-cb23-471f-b9ce-a536d3b51d20 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:28.386731 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8a6abeb1-cb23-471f-b9ce-a536d3b51d20 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:28.387412 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8a6abeb1-cb23-471f-b9ce-a536d3b51d20 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:28.387852 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8a6abeb1-cb23-471f-b9ce-a536d3b51d20 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:28.388357 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8a6abeb1-cb23-471f-b9ce-a536d3b51d20 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:28.523631 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-8a6abeb1-cb23-471f-b9ce-a536d3b51d20 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:28.531522 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-8a6abeb1-cb23-471f-b9ce-a536d3b51d20 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c" status: 200 len: 1522 microversion: 2.1 time: 0.157864 Sep 16 01:56:28.532212 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 193/371] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:28 2022] GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:28.800592 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-9b812bcc-5e05-489b-976d-2900379c2b93 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:28.801880 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-9b812bcc-5e05-489b-976d-2900379c2b93 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] [instance: 6a242b28-4c02-4ae3-b0b3-9e6df39cad1d] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:28.804349 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_api:SELECT=65,nova_api:INSERT=3 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:56:28.809622 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9b812bcc-5e05-489b-976d-2900379c2b93 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:28.810343 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9b812bcc-5e05-489b-976d-2900379c2b93 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:28.810941 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9b812bcc-5e05-489b-976d-2900379c2b93 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:28.812484 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9b812bcc-5e05-489b-976d-2900379c2b93 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:28.813571 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9b812bcc-5e05-489b-976d-2900379c2b93 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:28.814017 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9b812bcc-5e05-489b-976d-2900379c2b93 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:28.947193 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-9b812bcc-5e05-489b-976d-2900379c2b93 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a422989ce94168a042135234bea46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0380c941f644a794f51e1f575faf00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:28.958445 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-9b812bcc-5e05-489b-976d-2900379c2b93 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] 10.222.0.42 "GET /compute/v2.1/servers/6a242b28-4c02-4ae3-b0b3-9e6df39cad1d" status: 200 len: 1314 microversion: 2.1 time: 0.163984 Sep 16 01:56:28.959165 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 179/372] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:28 2022] GET /compute/v2.1/servers/6a242b28-4c02-4ae3-b0b3-9e6df39cad1d => generated 1314 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:29.554594 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-a3ce25f2-3dd8-4f8e-b9f6-c56e64fbb79a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:29.555212 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-a3ce25f2-3dd8-4f8e-b9f6-c56e64fbb79a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 48c9b577-5e65-464f-9328-da6dc694277c] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:29.561152 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a3ce25f2-3dd8-4f8e-b9f6-c56e64fbb79a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:29.561627 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a3ce25f2-3dd8-4f8e-b9f6-c56e64fbb79a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:29.562052 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a3ce25f2-3dd8-4f8e-b9f6-c56e64fbb79a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:29.562728 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a3ce25f2-3dd8-4f8e-b9f6-c56e64fbb79a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:29.563295 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a3ce25f2-3dd8-4f8e-b9f6-c56e64fbb79a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:29.563810 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a3ce25f2-3dd8-4f8e-b9f6-c56e64fbb79a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:29.690799 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-a3ce25f2-3dd8-4f8e-b9f6-c56e64fbb79a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:29.694298 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:56:29.699490 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-a3ce25f2-3dd8-4f8e-b9f6-c56e64fbb79a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c" status: 200 len: 1522 microversion: 2.1 time: 0.148806 Sep 16 01:56:29.700082 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 194/373] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:29 2022] GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:29.982200 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-a1424047-ddd8-4b08-934c-d2bedbb320f8 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:29.982720 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-a1424047-ddd8-4b08-934c-d2bedbb320f8 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] [instance: 6a242b28-4c02-4ae3-b0b3-9e6df39cad1d] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:29.989255 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a1424047-ddd8-4b08-934c-d2bedbb320f8 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:29.989734 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a1424047-ddd8-4b08-934c-d2bedbb320f8 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:29.990159 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a1424047-ddd8-4b08-934c-d2bedbb320f8 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:29.990844 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a1424047-ddd8-4b08-934c-d2bedbb320f8 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:29.991291 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a1424047-ddd8-4b08-934c-d2bedbb320f8 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:29.991711 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a1424047-ddd8-4b08-934c-d2bedbb320f8 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:30.125830 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-a1424047-ddd8-4b08-934c-d2bedbb320f8 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a422989ce94168a042135234bea46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0380c941f644a794f51e1f575faf00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:30.135635 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-a1424047-ddd8-4b08-934c-d2bedbb320f8 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] 10.222.0.42 "GET /compute/v2.1/servers/6a242b28-4c02-4ae3-b0b3-9e6df39cad1d" status: 200 len: 1498 microversion: 2.1 time: 0.157244 Sep 16 01:56:30.136284 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 180/374] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:29 2022] GET /compute/v2.1/servers/6a242b28-4c02-4ae3-b0b3-9e6df39cad1d => generated 1498 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:30.724137 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-46f466b7-f6b6-4769-8e7d-6d5879210f04 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:30.724733 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-46f466b7-f6b6-4769-8e7d-6d5879210f04 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 48c9b577-5e65-464f-9328-da6dc694277c] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:30.731505 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-46f466b7-f6b6-4769-8e7d-6d5879210f04 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:30.732016 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-46f466b7-f6b6-4769-8e7d-6d5879210f04 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:30.732456 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-46f466b7-f6b6-4769-8e7d-6d5879210f04 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:30.733177 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-46f466b7-f6b6-4769-8e7d-6d5879210f04 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:30.733635 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-46f466b7-f6b6-4769-8e7d-6d5879210f04 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:30.734060 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-46f466b7-f6b6-4769-8e7d-6d5879210f04 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:30.865577 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-46f466b7-f6b6-4769-8e7d-6d5879210f04 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:30.873075 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-46f466b7-f6b6-4769-8e7d-6d5879210f04 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c" status: 200 len: 1522 microversion: 2.1 time: 0.153841 Sep 16 01:56:30.873631 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 195/375] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:30 2022] GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c => generated 1522 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:31.416915 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-8788aa14-bbce-45aa-a5b3-59f835405810 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:31.417451 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-8788aa14-bbce-45aa-a5b3-59f835405810 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] [instance: 6a242b28-4c02-4ae3-b0b3-9e6df39cad1d] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:31.424437 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8788aa14-bbce-45aa-a5b3-59f835405810 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:31.424923 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8788aa14-bbce-45aa-a5b3-59f835405810 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:31.425356 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8788aa14-bbce-45aa-a5b3-59f835405810 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:31.426047 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8788aa14-bbce-45aa-a5b3-59f835405810 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:31.426670 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8788aa14-bbce-45aa-a5b3-59f835405810 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:31.427088 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8788aa14-bbce-45aa-a5b3-59f835405810 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:31.476148 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-8788aa14-bbce-45aa-a5b3-59f835405810 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] [instance: 6a242b28-4c02-4ae3-b0b3-9e6df39cad1d] Going to try to terminate instance {{(pid=120440) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 01:56:31.566631 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-8788aa14-bbce-45aa-a5b3-59f835405810 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6a242b28-4c02-4ae3-b0b3-9e6df39cad1d" status: 204 len: 0 microversion: 2.1 time: 0.153234 Sep 16 01:56:31.567185 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 181/376] 10.222.0.42 () {58 vars in 1239 bytes} [Fri Sep 16 01:56:31 2022] DELETE /compute/v2.1/servers/6a242b28-4c02-4ae3-b0b3-9e6df39cad1d => generated 0 bytes in 155 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 01:56:31.576829 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-7c448792-8eec-467c-bb5e-cc7d95646857 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:31.577881 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-7c448792-8eec-467c-bb5e-cc7d95646857 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] [instance: 6a242b28-4c02-4ae3-b0b3-9e6df39cad1d] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:31.585617 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7c448792-8eec-467c-bb5e-cc7d95646857 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:31.586151 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7c448792-8eec-467c-bb5e-cc7d95646857 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:31.586646 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7c448792-8eec-467c-bb5e-cc7d95646857 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:31.587630 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7c448792-8eec-467c-bb5e-cc7d95646857 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:31.588153 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7c448792-8eec-467c-bb5e-cc7d95646857 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:31.592127 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7c448792-8eec-467c-bb5e-cc7d95646857 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:31.899573 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-fef57f5e-1205-436c-90ee-0ec389655211 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:31.901117 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-fef57f5e-1205-436c-90ee-0ec389655211 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 48c9b577-5e65-464f-9328-da6dc694277c] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:31.910660 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-fef57f5e-1205-436c-90ee-0ec389655211 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:31.911380 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-fef57f5e-1205-436c-90ee-0ec389655211 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:31.911824 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-fef57f5e-1205-436c-90ee-0ec389655211 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:31.912642 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-fef57f5e-1205-436c-90ee-0ec389655211 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:31.913392 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-fef57f5e-1205-436c-90ee-0ec389655211 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:31.914219 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-fef57f5e-1205-436c-90ee-0ec389655211 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:32.002749 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-7c448792-8eec-467c-bb5e-cc7d95646857 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a422989ce94168a042135234bea46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0380c941f644a794f51e1f575faf00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:32.017757 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-7c448792-8eec-467c-bb5e-cc7d95646857 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] 10.222.0.42 "GET /compute/v2.1/servers/6a242b28-4c02-4ae3-b0b3-9e6df39cad1d" status: 200 len: 1504 microversion: 2.1 time: 0.445047 Sep 16 01:56:32.018329 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 196/377] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:31 2022] GET /compute/v2.1/servers/6a242b28-4c02-4ae3-b0b3-9e6df39cad1d => generated 1504 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:32.061987 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-fef57f5e-1205-436c-90ee-0ec389655211 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:32.070615 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-fef57f5e-1205-436c-90ee-0ec389655211 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c" status: 200 len: 1522 microversion: 2.1 time: 0.176948 Sep 16 01:56:32.071190 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 182/378] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:31 2022] GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c => generated 1522 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:33.041865 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-63b8236d-e133-4cbb-95f0-0d3d34c7c527 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:33.042558 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-63b8236d-e133-4cbb-95f0-0d3d34c7c527 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] [instance: 6a242b28-4c02-4ae3-b0b3-9e6df39cad1d] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:33.049056 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-63b8236d-e133-4cbb-95f0-0d3d34c7c527 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:33.049542 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-63b8236d-e133-4cbb-95f0-0d3d34c7c527 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:33.049969 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-63b8236d-e133-4cbb-95f0-0d3d34c7c527 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:33.050656 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-63b8236d-e133-4cbb-95f0-0d3d34c7c527 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:33.051106 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-63b8236d-e133-4cbb-95f0-0d3d34c7c527 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:33.051530 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-63b8236d-e133-4cbb-95f0-0d3d34c7c527 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:33.094226 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-92f322c4-3e6a-4a80-a053-e8e4aaa950b8 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:33.094953 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-92f322c4-3e6a-4a80-a053-e8e4aaa950b8 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 48c9b577-5e65-464f-9328-da6dc694277c] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:33.101363 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-92f322c4-3e6a-4a80-a053-e8e4aaa950b8 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:33.101849 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-92f322c4-3e6a-4a80-a053-e8e4aaa950b8 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:33.102282 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-92f322c4-3e6a-4a80-a053-e8e4aaa950b8 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:33.103344 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-92f322c4-3e6a-4a80-a053-e8e4aaa950b8 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:33.104259 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-92f322c4-3e6a-4a80-a053-e8e4aaa950b8 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:33.104690 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-92f322c4-3e6a-4a80-a053-e8e4aaa950b8 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:33.185724 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-63b8236d-e133-4cbb-95f0-0d3d34c7c527 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a422989ce94168a042135234bea46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0380c941f644a794f51e1f575faf00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:33.196371 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-63b8236d-e133-4cbb-95f0-0d3d34c7c527 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] 10.222.0.42 "GET /compute/v2.1/servers/6a242b28-4c02-4ae3-b0b3-9e6df39cad1d" status: 200 len: 1504 microversion: 2.1 time: 0.158553 Sep 16 01:56:33.197244 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 197/379] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:33 2022] GET /compute/v2.1/servers/6a242b28-4c02-4ae3-b0b3-9e6df39cad1d => generated 1504 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:33.263494 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-92f322c4-3e6a-4a80-a053-e8e4aaa950b8 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:33.271905 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-92f322c4-3e6a-4a80-a053-e8e4aaa950b8 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c" status: 200 len: 1522 microversion: 2.1 time: 0.181578 Sep 16 01:56:33.272726 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 183/380] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:33 2022] GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c => generated 1522 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 01:56:33.901394 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-c589229a-4c9f-4094-9c8e-1a05a5ba22f0 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1467882837", "imageRef": "1546da04-912c-44c6-b4b9-34fba35e08f6", "flavorRef": "452"}} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:56:33.960206 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.network.neutron [None req-c589229a-4c9f-4094-9c8e-1a05a5ba22f0 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] validate_networks() for None {{(pid=120441) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 01:56:34.220733 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-d6b33f61-ae0a-4bb4-a428-b39cc363db90 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:34.221351 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-d6b33f61-ae0a-4bb4-a428-b39cc363db90 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] [instance: 6a242b28-4c02-4ae3-b0b3-9e6df39cad1d] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:34.228083 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d6b33f61-ae0a-4bb4-a428-b39cc363db90 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:34.228800 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d6b33f61-ae0a-4bb4-a428-b39cc363db90 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:34.229397 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d6b33f61-ae0a-4bb4-a428-b39cc363db90 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:34.230322 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d6b33f61-ae0a-4bb4-a428-b39cc363db90 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:34.230942 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d6b33f61-ae0a-4bb4-a428-b39cc363db90 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:34.231372 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d6b33f61-ae0a-4bb4-a428-b39cc363db90 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:34.381892 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.virt.hardware [None req-c589229a-4c9f-4094-9c8e-1a05a5ba22f0 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Flavor limits 0:0:0 {{(pid=120441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 01:56:34.382948 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.virt.hardware [None req-c589229a-4c9f-4094-9c8e-1a05a5ba22f0 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Image limits 0:0:0 {{(pid=120441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 01:56:34.383394 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.virt.hardware [None req-c589229a-4c9f-4094-9c8e-1a05a5ba22f0 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Flavor pref 0:0:0 {{(pid=120441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 01:56:34.383983 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.virt.hardware [None req-c589229a-4c9f-4094-9c8e-1a05a5ba22f0 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Image pref 0:0:0 {{(pid=120441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 01:56:34.384393 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.virt.hardware [None req-c589229a-4c9f-4094-9c8e-1a05a5ba22f0 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 01:56:34.394209 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c589229a-4c9f-4094-9c8e-1a05a5ba22f0 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:34.394686 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c589229a-4c9f-4094-9c8e-1a05a5ba22f0 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:34.395111 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c589229a-4c9f-4094-9c8e-1a05a5ba22f0 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:34.395818 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c589229a-4c9f-4094-9c8e-1a05a5ba22f0 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:34.396289 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c589229a-4c9f-4094-9c8e-1a05a5ba22f0 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:34.396860 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c589229a-4c9f-4094-9c8e-1a05a5ba22f0 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:34.418122 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.quota [None req-c589229a-4c9f-4094-9c8e-1a05a5ba22f0 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Getting quotas for project fbe6e7560b314358bd9589ac38b69320. Resources: {'cores', 'ram', 'instances'} {{(pid=120441) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 01:56:34.422023 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.quota [None req-c589229a-4c9f-4094-9c8e-1a05a5ba22f0 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Getting quotas for user a194fd36e3024b1f86837cc12ac0c2bb and project fbe6e7560b314358bd9589ac38b69320. Resources: {'cores', 'ram', 'instances'} {{(pid=120441) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 01:56:34.433844 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-c589229a-4c9f-4094-9c8e-1a05a5ba22f0 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Going to run 1 instances... {{(pid=120441) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 01:56:34.436156 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-c589229a-4c9f-4094-9c8e-1a05a5ba22f0 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] [instance: d49774a5-7f65-4e40-9a54-a51ccb508212] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1546da04-912c-44c6-b4b9-34fba35e08f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120441) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 01:56:34.458458 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-d6b33f61-ae0a-4bb4-a428-b39cc363db90 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a422989ce94168a042135234bea46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0380c941f644a794f51e1f575faf00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:34.466924 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-d6b33f61-ae0a-4bb4-a428-b39cc363db90 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] 10.222.0.42 "GET /compute/v2.1/servers/6a242b28-4c02-4ae3-b0b3-9e6df39cad1d" status: 200 len: 1504 microversion: 2.1 time: 0.250726 Sep 16 01:56:34.467888 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 184/381] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:34 2022] GET /compute/v2.1/servers/6a242b28-4c02-4ae3-b0b3-9e6df39cad1d => generated 1504 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 01:56:34.490462 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-7dae1803-cc49-46e4-b8d7-0efeeb0380ee tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:34.491254 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-7dae1803-cc49-46e4-b8d7-0efeeb0380ee tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 48c9b577-5e65-464f-9328-da6dc694277c] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:34.510495 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7dae1803-cc49-46e4-b8d7-0efeeb0380ee tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:34.511470 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7dae1803-cc49-46e4-b8d7-0efeeb0380ee tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:34.512133 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7dae1803-cc49-46e4-b8d7-0efeeb0380ee tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:34.513539 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7dae1803-cc49-46e4-b8d7-0efeeb0380ee tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:34.514155 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7dae1803-cc49-46e4-b8d7-0efeeb0380ee tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:34.514896 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7dae1803-cc49-46e4-b8d7-0efeeb0380ee tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:34.535102 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-c589229a-4c9f-4094-9c8e-1a05a5ba22f0 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.637933 Sep 16 01:56:34.537090 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 198/382] 10.222.0.42 () {60 vars in 1147 bytes} [Fri Sep 16 01:56:33 2022] POST /compute/v2.1/servers => generated 380 bytes in 640 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 01:56:34.559182 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-6329f588-8f70-46ea-ad7b-887bc7ffe25c tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:34.561044 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-6329f588-8f70-46ea-ad7b-887bc7ffe25c tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] [instance: d49774a5-7f65-4e40-9a54-a51ccb508212] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:34.662189 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-6329f588-8f70-46ea-ad7b-887bc7ffe25c tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a194fd36e3024b1f86837cc12ac0c2bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6e7560b314358bd9589ac38b69320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:34.673961 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-6329f588-8f70-46ea-ad7b-887bc7ffe25c tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] 10.222.0.42 "GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212" status: 200 len: 1215 microversion: 2.1 time: 0.128286 Sep 16 01:56:34.674964 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 199/383] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:34 2022] GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212 => generated 1215 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:34.681755 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [req-ab1d8851-572f-49c9-9c57-65a53c960fe4 req-9ddc5026-299b-4ac4-8aab-96aed0e270c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6a242b28-4c02-4ae3-b0b3-9e6df39cad1d", "name": "network-vif-deleted", "tag": "a13f9521-b74b-4b3a-a8a1-20cc50cc9a7e"}]} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:56:34.694407 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-ab1d8851-572f-49c9-9c57-65a53c960fe4 req-9ddc5026-299b-4ac4-8aab-96aed0e270c5 service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:34.695453 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-ab1d8851-572f-49c9-9c57-65a53c960fe4 req-9ddc5026-299b-4ac4-8aab-96aed0e270c5 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:34.696207 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-ab1d8851-572f-49c9-9c57-65a53c960fe4 req-9ddc5026-299b-4ac4-8aab-96aed0e270c5 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:34.712201 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.compute.server_external_events [req-ab1d8851-572f-49c9-9c57-65a53c960fe4 req-9ddc5026-299b-4ac4-8aab-96aed0e270c5 service nova] Creating event network-vif-deleted:a13f9521-b74b-4b3a-a8a1-20cc50cc9a7e for instance 6a242b28-4c02-4ae3-b0b3-9e6df39cad1d on hv-cinder-84914 Sep 16 01:56:34.717271 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [req-ab1d8851-572f-49c9-9c57-65a53c960fe4 req-9ddc5026-299b-4ac4-8aab-96aed0e270c5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041027 Sep 16 01:56:34.717956 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 200/384] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 01:56:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:56:34.724075 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-7dae1803-cc49-46e4-b8d7-0efeeb0380ee tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:34.732215 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-7dae1803-cc49-46e4-b8d7-0efeeb0380ee tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c" status: 200 len: 1522 microversion: 2.1 time: 0.262933 Sep 16 01:56:34.733258 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 185/385] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:34 2022] GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c => generated 1522 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:35.494273 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-83ae76a5-5938-4de9-98bb-9d1a8ce4ab77 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:35.495004 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-83ae76a5-5938-4de9-98bb-9d1a8ce4ab77 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] [instance: 6a242b28-4c02-4ae3-b0b3-9e6df39cad1d] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:35.503079 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-83ae76a5-5938-4de9-98bb-9d1a8ce4ab77 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:35.503752 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-83ae76a5-5938-4de9-98bb-9d1a8ce4ab77 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:35.504624 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-83ae76a5-5938-4de9-98bb-9d1a8ce4ab77 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:35.505375 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-83ae76a5-5938-4de9-98bb-9d1a8ce4ab77 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:35.505843 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-83ae76a5-5938-4de9-98bb-9d1a8ce4ab77 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:35.506273 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-83ae76a5-5938-4de9-98bb-9d1a8ce4ab77 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:35.538505 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-83ae76a5-5938-4de9-98bb-9d1a8ce4ab77 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:35.539314 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-83ae76a5-5938-4de9-98bb-9d1a8ce4ab77 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:35.539748 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-83ae76a5-5938-4de9-98bb-9d1a8ce4ab77 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:35.540414 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.objects.instance [None req-83ae76a5-5938-4de9-98bb-9d1a8ce4ab77 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lazy-loading 'fault' on Instance uuid 6a242b28-4c02-4ae3-b0b3-9e6df39cad1d {{(pid=120441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 01:56:35.588689 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-83ae76a5-5938-4de9-98bb-9d1a8ce4ab77 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '47a422989ce94168a042135234bea46b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '3a0380c941f644a794f51e1f575faf00', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:35.600531 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-83ae76a5-5938-4de9-98bb-9d1a8ce4ab77 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] 10.222.0.42 "GET /compute/v2.1/servers/6a242b28-4c02-4ae3-b0b3-9e6df39cad1d" status: 200 len: 1304 microversion: 2.1 time: 0.112704 Sep 16 01:56:35.601123 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 201/386] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:35 2022] GET /compute/v2.1/servers/6a242b28-4c02-4ae3-b0b3-9e6df39cad1d => generated 1304 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 01:56:35.702335 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-1614403d-c6c2-4c94-9fbc-308916c8ff0b tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:35.703477 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-1614403d-c6c2-4c94-9fbc-308916c8ff0b tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] [instance: d49774a5-7f65-4e40-9a54-a51ccb508212] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:35.710916 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1614403d-c6c2-4c94-9fbc-308916c8ff0b tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:35.711323 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1614403d-c6c2-4c94-9fbc-308916c8ff0b tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:35.711844 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1614403d-c6c2-4c94-9fbc-308916c8ff0b tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:35.712758 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1614403d-c6c2-4c94-9fbc-308916c8ff0b tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:35.713306 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1614403d-c6c2-4c94-9fbc-308916c8ff0b tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:35.714187 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1614403d-c6c2-4c94-9fbc-308916c8ff0b tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:35.757464 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-8cd4ca7d-c411-4bf8-adaf-976757791d13 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:35.758076 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-8cd4ca7d-c411-4bf8-adaf-976757791d13 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 48c9b577-5e65-464f-9328-da6dc694277c] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:35.765525 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8cd4ca7d-c411-4bf8-adaf-976757791d13 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:35.766067 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8cd4ca7d-c411-4bf8-adaf-976757791d13 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:35.766850 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8cd4ca7d-c411-4bf8-adaf-976757791d13 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:35.767591 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8cd4ca7d-c411-4bf8-adaf-976757791d13 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:35.768129 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8cd4ca7d-c411-4bf8-adaf-976757791d13 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:35.768736 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8cd4ca7d-c411-4bf8-adaf-976757791d13 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:35.785689 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-1614403d-c6c2-4c94-9fbc-308916c8ff0b tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a194fd36e3024b1f86837cc12ac0c2bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6e7560b314358bd9589ac38b69320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:35.794209 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-1614403d-c6c2-4c94-9fbc-308916c8ff0b tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] 10.222.0.42 "GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212" status: 200 len: 1211 microversion: 2.1 time: 0.098419 Sep 16 01:56:35.795362 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 186/387] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:35 2022] GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212 => generated 1211 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:35.933981 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-8cd4ca7d-c411-4bf8-adaf-976757791d13 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:35.941848 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-8cd4ca7d-c411-4bf8-adaf-976757791d13 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c" status: 200 len: 1522 microversion: 2.1 time: 0.188547 Sep 16 01:56:35.942407 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 202/388] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:35 2022] GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c => generated 1522 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 01:56:36.624516 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-3d775cc9-3de6-4e85-bd53-b18a31ce8203 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:36.625676 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-3d775cc9-3de6-4e85-bd53-b18a31ce8203 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] [instance: 6a242b28-4c02-4ae3-b0b3-9e6df39cad1d] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:36.631783 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3d775cc9-3de6-4e85-bd53-b18a31ce8203 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:36.632293 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3d775cc9-3de6-4e85-bd53-b18a31ce8203 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:36.632729 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3d775cc9-3de6-4e85-bd53-b18a31ce8203 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:36.633405 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3d775cc9-3de6-4e85-bd53-b18a31ce8203 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:36.633853 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3d775cc9-3de6-4e85-bd53-b18a31ce8203 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:36.634277 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3d775cc9-3de6-4e85-bd53-b18a31ce8203 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:36.653623 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.wsgi [None req-3d775cc9-3de6-4e85-bd53-b18a31ce8203 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] HTTP exception thrown: Instance 6a242b28-4c02-4ae3-b0b3-9e6df39cad1d could not be found. Sep 16 01:56:36.656625 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-3d775cc9-3de6-4e85-bd53-b18a31ce8203 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Request method failure captured: Sep 16 01:56:36.656625 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: request: GET /compute/v2.1/servers/6a242b28-4c02-4ae3-b0b3-9e6df39cad1d HTTP/1.1 Sep 16 01:56:36.656625 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept: application/json Sep 16 01:56:36.656625 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept-Encoding: identity Sep 16 01:56:36.656625 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Connection: close Sep 16 01:56:36.656625 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Length: 0 Sep 16 01:56:36.656625 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Type: application/json Sep 16 01:56:36.656625 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Host: 10.222.0.42 Sep 16 01:56:36.656625 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Openstack-System-Scope: None Sep 16 01:56:36.656625 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: User-Agent: python-urllib3/1.26.12 Sep 16 01:56:36.656625 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Auth-Token: gAAAAABjI9eTmBRcQ55f471d-zJYvNr88eAp17U512MRuEIRHuh3b1bDTuaAbN6of90Cjdb3-XQoPheamojkhdfX8XSg9SXQk0i_PZwvYAMq32dY9Z_HWgZ187tVv3vfZ6uQOW3c7HNBHSX4OcUplFWfcrn4uPZXx1t5vZWDCHby-IddFGVNP-4 Sep 16 01:56:36.656625 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Id: None Sep 16 01:56:36.656625 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Name: None Sep 16 01:56:36.656625 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Identity-Status: Confirmed Sep 16 01:56:36.656625 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Is-Admin-Project: True Sep 16 01:56:36.656625 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Id: default Sep 16 01:56:36.656625 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Name: Default Sep 16 01:56:36.656625 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Id: 3a0380c941f644a794f51e1f575faf00 Sep 16 01:56:36.656625 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Name: tempest-VolumesActionsTest-1146828490 Sep 16 01:56:36.656625 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Role: member,reader Sep 16 01:56:36.656625 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Roles: member,reader Sep 16 01:56:36.658359 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/3a0380c941f644a794f51e1f575faf00"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3a0380c941f644a794f51e1f575faf00"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_3a0380c941f644a794f51e1f575faf00"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/3a0380c941f644a794f51e1f575faf00"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 01:56:36.658359 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant: tempest-VolumesActionsTest-1146828490 Sep 16 01:56:36.658359 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Id: 3a0380c941f644a794f51e1f575faf00 Sep 16 01:56:36.658359 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Name: tempest-VolumesActionsTest-1146828490 Sep 16 01:56:36.658359 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User: tempest-VolumesActionsTest-1146828490-project Sep 16 01:56:36.658359 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Id: default Sep 16 01:56:36.658359 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Name: Default Sep 16 01:56:36.658359 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Id: 47a422989ce94168a042135234bea46b Sep 16 01:56:36.658359 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Name: tempest-VolumesActionsTest-1146828490-project Sep 16 01:56:36.658359 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: method: > Sep 16 01:56:36.658359 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: exception: Instance 6a242b28-4c02-4ae3-b0b3-9e6df39cad1d could not be found. Sep 16 01:56:36.658359 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: action_args: {'id': '6a242b28-4c02-4ae3-b0b3-9e6df39cad1d'} Sep 16 01:56:36.659097 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 01:56:36.659097 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:56:36.659097 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 01:56:36.659097 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 01:56:36.659097 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 01:56:36.659097 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 01:56:36.659097 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 01:56:36.659097 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 01:56:36.659097 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 01:56:36.659097 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 01:56:36.659097 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6a242b28-4c02-4ae3-b0b3-9e6df39cad1d could not be found. Sep 16 01:56:36.659097 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 01:56:36.659097 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:56:36.659097 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 01:56:36.659097 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:56:36.659097 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 01:56:36.659097 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 01:56:36.659097 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 01:56:36.659097 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 01:56:36.659097 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 01:56:36.660642 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 01:56:36.660642 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 01:56:36.660642 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 01:56:36.660642 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 01:56:36.660642 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 01:56:36.660642 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 01:56:36.660642 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 01:56:36.660642 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6a242b28-4c02-4ae3-b0b3-9e6df39cad1d could not be found. Sep 16 01:56:36.660642 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 01:56:36.660642 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:56:36.660642 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 01:56:36.660642 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:56:36.660642 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 01:56:36.660642 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 01:56:36.660642 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 01:56:36.660642 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 01:56:36.660642 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6a242b28-4c02-4ae3-b0b3-9e6df39cad1d could not be found. Sep 16 01:56:36.660642 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 01:56:36.662037 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-3d775cc9-3de6-4e85-bd53-b18a31ce8203 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] Returning 404 to user: Instance 6a242b28-4c02-4ae3-b0b3-9e6df39cad1d could not be found. {{(pid=120440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 01:56:36.662037 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-3d775cc9-3de6-4e85-bd53-b18a31ce8203 tempest-VolumesActionsTest-1146828490 tempest-VolumesActionsTest-1146828490-project] 10.222.0.42 "GET /compute/v2.1/servers/6a242b28-4c02-4ae3-b0b3-9e6df39cad1d" status: 404 len: 111 microversion: 2.1 time: 0.037481 Sep 16 01:56:36.662037 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 187/389] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:36 2022] GET /compute/v2.1/servers/6a242b28-4c02-4ae3-b0b3-9e6df39cad1d => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 01:56:36.818875 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-b40ebc78-3386-486a-a3d2-beec8f1ab364 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:36.819476 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-b40ebc78-3386-486a-a3d2-beec8f1ab364 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] [instance: d49774a5-7f65-4e40-9a54-a51ccb508212] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:36.825262 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b40ebc78-3386-486a-a3d2-beec8f1ab364 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:36.825732 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b40ebc78-3386-486a-a3d2-beec8f1ab364 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:36.826157 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b40ebc78-3386-486a-a3d2-beec8f1ab364 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:36.826829 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b40ebc78-3386-486a-a3d2-beec8f1ab364 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:36.827280 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b40ebc78-3386-486a-a3d2-beec8f1ab364 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:36.827690 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b40ebc78-3386-486a-a3d2-beec8f1ab364 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:36.892735 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-b40ebc78-3386-486a-a3d2-beec8f1ab364 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a194fd36e3024b1f86837cc12ac0c2bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6e7560b314358bd9589ac38b69320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:36.901637 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-b40ebc78-3386-486a-a3d2-beec8f1ab364 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] 10.222.0.42 "GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212" status: 200 len: 1267 microversion: 2.1 time: 0.086393 Sep 16 01:56:36.902206 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 203/390] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:36 2022] GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212 => generated 1267 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:36.964374 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-57bf4b0b-cb6f-4a50-986a-c6b6e29af238 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:36.964995 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-57bf4b0b-cb6f-4a50-986a-c6b6e29af238 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 48c9b577-5e65-464f-9328-da6dc694277c] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:36.971412 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-57bf4b0b-cb6f-4a50-986a-c6b6e29af238 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:36.971896 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-57bf4b0b-cb6f-4a50-986a-c6b6e29af238 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:36.972371 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-57bf4b0b-cb6f-4a50-986a-c6b6e29af238 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:36.973060 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-57bf4b0b-cb6f-4a50-986a-c6b6e29af238 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:36.973514 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-57bf4b0b-cb6f-4a50-986a-c6b6e29af238 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:36.973947 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-57bf4b0b-cb6f-4a50-986a-c6b6e29af238 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:37.113086 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-57bf4b0b-cb6f-4a50-986a-c6b6e29af238 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:37.120593 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-57bf4b0b-cb6f-4a50-986a-c6b6e29af238 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c" status: 200 len: 1522 microversion: 2.1 time: 0.160028 Sep 16 01:56:37.123966 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 188/391] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:36 2022] GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c => generated 1522 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:37.924749 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-a977d9fe-a9fd-49ac-9ec2-4425e4ccf595 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:37.925357 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-a977d9fe-a9fd-49ac-9ec2-4425e4ccf595 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] [instance: d49774a5-7f65-4e40-9a54-a51ccb508212] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:37.931129 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a977d9fe-a9fd-49ac-9ec2-4425e4ccf595 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:37.931608 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a977d9fe-a9fd-49ac-9ec2-4425e4ccf595 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:37.932069 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a977d9fe-a9fd-49ac-9ec2-4425e4ccf595 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:37.932749 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a977d9fe-a9fd-49ac-9ec2-4425e4ccf595 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:37.933202 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a977d9fe-a9fd-49ac-9ec2-4425e4ccf595 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:37.933623 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a977d9fe-a9fd-49ac-9ec2-4425e4ccf595 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:37.994993 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-a977d9fe-a9fd-49ac-9ec2-4425e4ccf595 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a194fd36e3024b1f86837cc12ac0c2bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6e7560b314358bd9589ac38b69320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:38.003318 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-a977d9fe-a9fd-49ac-9ec2-4425e4ccf595 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] 10.222.0.42 "GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212" status: 200 len: 1285 microversion: 2.1 time: 0.082817 Sep 16 01:56:38.004139 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 204/392] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:37 2022] GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212 => generated 1285 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:38.144910 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-1068fedf-1c60-488a-b883-e93fac9d119f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:38.145532 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-1068fedf-1c60-488a-b883-e93fac9d119f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 48c9b577-5e65-464f-9328-da6dc694277c] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:38.151881 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1068fedf-1c60-488a-b883-e93fac9d119f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:38.152396 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1068fedf-1c60-488a-b883-e93fac9d119f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:38.152835 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1068fedf-1c60-488a-b883-e93fac9d119f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:38.153525 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1068fedf-1c60-488a-b883-e93fac9d119f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:38.153984 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1068fedf-1c60-488a-b883-e93fac9d119f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:38.154409 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1068fedf-1c60-488a-b883-e93fac9d119f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:38.284041 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-1068fedf-1c60-488a-b883-e93fac9d119f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:38.291811 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-1068fedf-1c60-488a-b883-e93fac9d119f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c" status: 200 len: 1522 microversion: 2.1 time: 0.151267 Sep 16 01:56:38.292397 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 189/393] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:38 2022] GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:39.026948 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-39e0d5fa-a246-4530-9b03-87af6019f57a tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:39.027461 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-39e0d5fa-a246-4530-9b03-87af6019f57a tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] [instance: d49774a5-7f65-4e40-9a54-a51ccb508212] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:39.033916 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-39e0d5fa-a246-4530-9b03-87af6019f57a tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:39.034385 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-39e0d5fa-a246-4530-9b03-87af6019f57a tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:39.034810 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-39e0d5fa-a246-4530-9b03-87af6019f57a tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:39.035481 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-39e0d5fa-a246-4530-9b03-87af6019f57a tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:39.035927 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-39e0d5fa-a246-4530-9b03-87af6019f57a tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:39.036363 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-39e0d5fa-a246-4530-9b03-87af6019f57a tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:39.098955 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-39e0d5fa-a246-4530-9b03-87af6019f57a tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a194fd36e3024b1f86837cc12ac0c2bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6e7560b314358bd9589ac38b69320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:39.106354 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-39e0d5fa-a246-4530-9b03-87af6019f57a tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] 10.222.0.42 "GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212" status: 200 len: 1285 microversion: 2.1 time: 0.083357 Sep 16 01:56:39.106907 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 205/394] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:39 2022] GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212 => generated 1285 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:39.315764 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-73f9cab7-1687-436f-8eee-b757e799c7f7 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:39.316325 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-73f9cab7-1687-436f-8eee-b757e799c7f7 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 48c9b577-5e65-464f-9328-da6dc694277c] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:39.322526 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-73f9cab7-1687-436f-8eee-b757e799c7f7 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:39.323008 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-73f9cab7-1687-436f-8eee-b757e799c7f7 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:39.323436 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-73f9cab7-1687-436f-8eee-b757e799c7f7 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:39.324138 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-73f9cab7-1687-436f-8eee-b757e799c7f7 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:39.324586 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-73f9cab7-1687-436f-8eee-b757e799c7f7 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:39.325004 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-73f9cab7-1687-436f-8eee-b757e799c7f7 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:39.454336 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-73f9cab7-1687-436f-8eee-b757e799c7f7 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:39.461925 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-73f9cab7-1687-436f-8eee-b757e799c7f7 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c" status: 200 len: 1522 microversion: 2.1 time: 0.150519 Sep 16 01:56:39.462478 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 190/395] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:39 2022] GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 01:56:40.128675 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-372d0d64-db58-47bd-b141-5ef382be5e1c tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:40.129544 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-372d0d64-db58-47bd-b141-5ef382be5e1c tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] [instance: d49774a5-7f65-4e40-9a54-a51ccb508212] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:40.135388 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-372d0d64-db58-47bd-b141-5ef382be5e1c tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:40.135866 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-372d0d64-db58-47bd-b141-5ef382be5e1c tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:40.136328 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-372d0d64-db58-47bd-b141-5ef382be5e1c tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:40.137005 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-372d0d64-db58-47bd-b141-5ef382be5e1c tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:40.137455 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-372d0d64-db58-47bd-b141-5ef382be5e1c tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:40.137877 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-372d0d64-db58-47bd-b141-5ef382be5e1c tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:40.198773 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-372d0d64-db58-47bd-b141-5ef382be5e1c tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a194fd36e3024b1f86837cc12ac0c2bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6e7560b314358bd9589ac38b69320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:40.207198 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-372d0d64-db58-47bd-b141-5ef382be5e1c tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] 10.222.0.42 "GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212" status: 200 len: 1285 microversion: 2.1 time: 0.082388 Sep 16 01:56:40.207751 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 206/396] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:40 2022] GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212 => generated 1285 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:40.486540 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-eef65cd8-2bfb-4e5d-ad9b-8a7d43cccc0a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:40.487124 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-eef65cd8-2bfb-4e5d-ad9b-8a7d43cccc0a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 48c9b577-5e65-464f-9328-da6dc694277c] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:40.493892 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-eef65cd8-2bfb-4e5d-ad9b-8a7d43cccc0a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:40.494366 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-eef65cd8-2bfb-4e5d-ad9b-8a7d43cccc0a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:40.494812 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-eef65cd8-2bfb-4e5d-ad9b-8a7d43cccc0a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:40.495508 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-eef65cd8-2bfb-4e5d-ad9b-8a7d43cccc0a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:40.495988 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-eef65cd8-2bfb-4e5d-ad9b-8a7d43cccc0a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:40.496424 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-eef65cd8-2bfb-4e5d-ad9b-8a7d43cccc0a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:40.629158 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-eef65cd8-2bfb-4e5d-ad9b-8a7d43cccc0a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:40.636763 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-eef65cd8-2bfb-4e5d-ad9b-8a7d43cccc0a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c" status: 200 len: 1522 microversion: 2.1 time: 0.155110 Sep 16 01:56:40.637326 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 191/397] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:40 2022] GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:41.230261 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-1e3e448e-232a-49d5-8d5a-5f8c78491eb3 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:41.230869 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-1e3e448e-232a-49d5-8d5a-5f8c78491eb3 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] [instance: d49774a5-7f65-4e40-9a54-a51ccb508212] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:41.236965 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1e3e448e-232a-49d5-8d5a-5f8c78491eb3 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:41.237444 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1e3e448e-232a-49d5-8d5a-5f8c78491eb3 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:41.237876 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1e3e448e-232a-49d5-8d5a-5f8c78491eb3 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:41.238554 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1e3e448e-232a-49d5-8d5a-5f8c78491eb3 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:41.239005 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1e3e448e-232a-49d5-8d5a-5f8c78491eb3 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:41.239420 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1e3e448e-232a-49d5-8d5a-5f8c78491eb3 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:41.300647 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-1e3e448e-232a-49d5-8d5a-5f8c78491eb3 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a194fd36e3024b1f86837cc12ac0c2bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6e7560b314358bd9589ac38b69320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:41.307994 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-1e3e448e-232a-49d5-8d5a-5f8c78491eb3 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] 10.222.0.42 "GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212" status: 200 len: 1285 microversion: 2.1 time: 0.081591 Sep 16 01:56:41.308555 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 207/398] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:41 2022] GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212 => generated 1285 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:41.661122 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-e7e06dcb-503c-4d7f-b7b8-b700a5991c1d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:41.661737 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-e7e06dcb-503c-4d7f-b7b8-b700a5991c1d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 48c9b577-5e65-464f-9328-da6dc694277c] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:41.668239 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e7e06dcb-503c-4d7f-b7b8-b700a5991c1d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:41.668709 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e7e06dcb-503c-4d7f-b7b8-b700a5991c1d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:41.669142 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e7e06dcb-503c-4d7f-b7b8-b700a5991c1d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:41.669813 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e7e06dcb-503c-4d7f-b7b8-b700a5991c1d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:41.670255 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e7e06dcb-503c-4d7f-b7b8-b700a5991c1d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:41.670671 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e7e06dcb-503c-4d7f-b7b8-b700a5991c1d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:41.819135 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-e7e06dcb-503c-4d7f-b7b8-b700a5991c1d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:41.827572 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-e7e06dcb-503c-4d7f-b7b8-b700a5991c1d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c" status: 200 len: 1522 microversion: 2.1 time: 0.171198 Sep 16 01:56:41.828464 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 192/399] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:41 2022] GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c => generated 1522 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:42.333235 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-21b293bb-fdbe-425a-9d93-401491941c4b tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:42.333937 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-21b293bb-fdbe-425a-9d93-401491941c4b tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] [instance: d49774a5-7f65-4e40-9a54-a51ccb508212] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:42.342670 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-21b293bb-fdbe-425a-9d93-401491941c4b tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:42.343476 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-21b293bb-fdbe-425a-9d93-401491941c4b tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:42.344839 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-21b293bb-fdbe-425a-9d93-401491941c4b tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:42.345966 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-21b293bb-fdbe-425a-9d93-401491941c4b tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:42.346711 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-21b293bb-fdbe-425a-9d93-401491941c4b tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:42.347426 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-21b293bb-fdbe-425a-9d93-401491941c4b tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:42.416832 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-21b293bb-fdbe-425a-9d93-401491941c4b tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a194fd36e3024b1f86837cc12ac0c2bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6e7560b314358bd9589ac38b69320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:42.427042 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-21b293bb-fdbe-425a-9d93-401491941c4b tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] 10.222.0.42 "GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212" status: 200 len: 1285 microversion: 2.1 time: 0.099552 Sep 16 01:56:42.427626 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 208/400] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:42 2022] GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212 => generated 1285 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:42.850814 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-5143cabc-ad44-4af6-a999-36b0a31bc349 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:42.851425 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-5143cabc-ad44-4af6-a999-36b0a31bc349 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 48c9b577-5e65-464f-9328-da6dc694277c] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:42.857884 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-5143cabc-ad44-4af6-a999-36b0a31bc349 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:42.858372 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-5143cabc-ad44-4af6-a999-36b0a31bc349 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:42.858815 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-5143cabc-ad44-4af6-a999-36b0a31bc349 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:42.860131 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-5143cabc-ad44-4af6-a999-36b0a31bc349 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:42.860583 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-5143cabc-ad44-4af6-a999-36b0a31bc349 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:42.861007 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-5143cabc-ad44-4af6-a999-36b0a31bc349 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:42.992995 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-5143cabc-ad44-4af6-a999-36b0a31bc349 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:43.001337 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-5143cabc-ad44-4af6-a999-36b0a31bc349 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c" status: 200 len: 1522 microversion: 2.1 time: 0.154231 Sep 16 01:56:43.001895 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 193/401] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:42 2022] GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c => generated 1522 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:43.455281 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-e2f956c2-5572-4679-b2d9-3e1e67ece676 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:43.455882 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-e2f956c2-5572-4679-b2d9-3e1e67ece676 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] [instance: d49774a5-7f65-4e40-9a54-a51ccb508212] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:43.461775 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e2f956c2-5572-4679-b2d9-3e1e67ece676 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:43.462250 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e2f956c2-5572-4679-b2d9-3e1e67ece676 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:43.462675 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e2f956c2-5572-4679-b2d9-3e1e67ece676 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:43.463346 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e2f956c2-5572-4679-b2d9-3e1e67ece676 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:43.463788 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e2f956c2-5572-4679-b2d9-3e1e67ece676 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:43.464227 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e2f956c2-5572-4679-b2d9-3e1e67ece676 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:43.526490 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-e2f956c2-5572-4679-b2d9-3e1e67ece676 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a194fd36e3024b1f86837cc12ac0c2bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6e7560b314358bd9589ac38b69320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:43.534688 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-e2f956c2-5572-4679-b2d9-3e1e67ece676 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] 10.222.0.42 "GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212" status: 200 len: 1273 microversion: 2.1 time: 0.083861 Sep 16 01:56:43.535232 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 209/402] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:43 2022] GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212 => generated 1273 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:44.024384 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-4d1b2c06-55e3-4b4f-938d-e20f91fb2164 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:44.025005 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-4d1b2c06-55e3-4b4f-938d-e20f91fb2164 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 48c9b577-5e65-464f-9328-da6dc694277c] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:44.031300 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-4d1b2c06-55e3-4b4f-938d-e20f91fb2164 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:44.031833 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-4d1b2c06-55e3-4b4f-938d-e20f91fb2164 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:44.032317 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-4d1b2c06-55e3-4b4f-938d-e20f91fb2164 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:44.033004 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-4d1b2c06-55e3-4b4f-938d-e20f91fb2164 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:44.033485 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-4d1b2c06-55e3-4b4f-938d-e20f91fb2164 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:44.033911 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-4d1b2c06-55e3-4b4f-938d-e20f91fb2164 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:44.037880 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:56:44.161300 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-4d1b2c06-55e3-4b4f-938d-e20f91fb2164 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:44.168867 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-4d1b2c06-55e3-4b4f-938d-e20f91fb2164 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c" status: 200 len: 1522 microversion: 2.1 time: 0.148403 Sep 16 01:56:44.169423 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 194/403] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:44 2022] GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:44.557354 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-bc34a6fc-eaba-434c-805b-95ccda7424e9 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:44.557910 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-bc34a6fc-eaba-434c-805b-95ccda7424e9 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] [instance: d49774a5-7f65-4e40-9a54-a51ccb508212] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:44.559817 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell0:SELECT=2 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:56:44.565896 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-bc34a6fc-eaba-434c-805b-95ccda7424e9 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:44.566377 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-bc34a6fc-eaba-434c-805b-95ccda7424e9 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:44.566813 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-bc34a6fc-eaba-434c-805b-95ccda7424e9 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:44.567505 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-bc34a6fc-eaba-434c-805b-95ccda7424e9 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:44.567980 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-bc34a6fc-eaba-434c-805b-95ccda7424e9 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:44.568685 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-bc34a6fc-eaba-434c-805b-95ccda7424e9 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:44.630415 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-bc34a6fc-eaba-434c-805b-95ccda7424e9 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a194fd36e3024b1f86837cc12ac0c2bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6e7560b314358bd9589ac38b69320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:44.637970 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-bc34a6fc-eaba-434c-805b-95ccda7424e9 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] 10.222.0.42 "GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212" status: 200 len: 1273 microversion: 2.1 time: 0.084648 Sep 16 01:56:44.638536 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 210/404] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:44 2022] GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212 => generated 1273 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:45.191960 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-0c1b252b-c69d-4af7-bf96-2effc79691ab tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:45.192573 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-0c1b252b-c69d-4af7-bf96-2effc79691ab tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 48c9b577-5e65-464f-9328-da6dc694277c] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:45.199777 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0c1b252b-c69d-4af7-bf96-2effc79691ab tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:45.200319 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0c1b252b-c69d-4af7-bf96-2effc79691ab tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:45.200876 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0c1b252b-c69d-4af7-bf96-2effc79691ab tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:45.201612 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0c1b252b-c69d-4af7-bf96-2effc79691ab tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:45.202070 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0c1b252b-c69d-4af7-bf96-2effc79691ab tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:45.202494 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0c1b252b-c69d-4af7-bf96-2effc79691ab tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:45.330653 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-0c1b252b-c69d-4af7-bf96-2effc79691ab tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:45.338443 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-0c1b252b-c69d-4af7-bf96-2effc79691ab tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c" status: 200 len: 1522 microversion: 2.1 time: 0.150636 Sep 16 01:56:45.338999 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 195/405] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:45 2022] GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c => generated 1522 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:45.660551 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-80452911-c401-4456-9099-3fd345acfed4 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:45.661589 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-80452911-c401-4456-9099-3fd345acfed4 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] [instance: d49774a5-7f65-4e40-9a54-a51ccb508212] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:45.662938 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell0:SELECT=8 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:56:45.668368 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-80452911-c401-4456-9099-3fd345acfed4 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:45.668855 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-80452911-c401-4456-9099-3fd345acfed4 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:45.669296 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-80452911-c401-4456-9099-3fd345acfed4 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:45.669984 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-80452911-c401-4456-9099-3fd345acfed4 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:45.670440 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-80452911-c401-4456-9099-3fd345acfed4 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:45.670863 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-80452911-c401-4456-9099-3fd345acfed4 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:45.734695 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-80452911-c401-4456-9099-3fd345acfed4 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a194fd36e3024b1f86837cc12ac0c2bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6e7560b314358bd9589ac38b69320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:45.742982 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-80452911-c401-4456-9099-3fd345acfed4 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] 10.222.0.42 "GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212" status: 200 len: 1273 microversion: 2.1 time: 0.086310 Sep 16 01:56:45.743534 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 211/406] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:45 2022] GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212 => generated 1273 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:46.364461 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-a237acfe-a597-4a4f-be0a-a6a08a13c7be tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:46.365115 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-a237acfe-a597-4a4f-be0a-a6a08a13c7be tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 48c9b577-5e65-464f-9328-da6dc694277c] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:46.371606 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a237acfe-a597-4a4f-be0a-a6a08a13c7be tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:46.372137 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a237acfe-a597-4a4f-be0a-a6a08a13c7be tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:46.372582 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a237acfe-a597-4a4f-be0a-a6a08a13c7be tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:46.373273 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a237acfe-a597-4a4f-be0a-a6a08a13c7be tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:46.373738 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a237acfe-a597-4a4f-be0a-a6a08a13c7be tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:46.374165 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a237acfe-a597-4a4f-be0a-a6a08a13c7be tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:46.513960 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-a237acfe-a597-4a4f-be0a-a6a08a13c7be tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:46.522460 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-a237acfe-a597-4a4f-be0a-a6a08a13c7be tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c" status: 200 len: 1522 microversion: 2.1 time: 0.161792 Sep 16 01:56:46.523222 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 196/407] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:46 2022] GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c => generated 1522 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:46.766241 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-5cabd91f-87cc-4fab-8626-5f16ae66d900 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:46.766932 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-5cabd91f-87cc-4fab-8626-5f16ae66d900 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] [instance: d49774a5-7f65-4e40-9a54-a51ccb508212] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:46.772900 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5cabd91f-87cc-4fab-8626-5f16ae66d900 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:46.773389 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5cabd91f-87cc-4fab-8626-5f16ae66d900 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:46.773822 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5cabd91f-87cc-4fab-8626-5f16ae66d900 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:46.774541 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5cabd91f-87cc-4fab-8626-5f16ae66d900 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:46.774998 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5cabd91f-87cc-4fab-8626-5f16ae66d900 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:46.775426 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5cabd91f-87cc-4fab-8626-5f16ae66d900 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:46.850023 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-5cabd91f-87cc-4fab-8626-5f16ae66d900 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a194fd36e3024b1f86837cc12ac0c2bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6e7560b314358bd9589ac38b69320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:46.857476 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-5cabd91f-87cc-4fab-8626-5f16ae66d900 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] 10.222.0.42 "GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212" status: 200 len: 1273 microversion: 2.1 time: 0.095320 Sep 16 01:56:46.858038 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 212/408] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:46 2022] GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212 => generated 1273 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:47.545433 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-0980e55a-85e5-4534-b49e-d2d812191aa5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:47.546024 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-0980e55a-85e5-4534-b49e-d2d812191aa5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 48c9b577-5e65-464f-9328-da6dc694277c] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:47.552767 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0980e55a-85e5-4534-b49e-d2d812191aa5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:47.553252 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0980e55a-85e5-4534-b49e-d2d812191aa5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:47.553688 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0980e55a-85e5-4534-b49e-d2d812191aa5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:47.554380 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0980e55a-85e5-4534-b49e-d2d812191aa5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:47.554829 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0980e55a-85e5-4534-b49e-d2d812191aa5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:47.555251 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0980e55a-85e5-4534-b49e-d2d812191aa5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:47.707391 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-0980e55a-85e5-4534-b49e-d2d812191aa5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:47.715577 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-0980e55a-85e5-4534-b49e-d2d812191aa5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c" status: 200 len: 1522 microversion: 2.1 time: 0.174042 Sep 16 01:56:47.716273 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 197/409] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:47 2022] GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c => generated 1522 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:47.881947 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-08d8d2a8-0404-47f7-9e69-f740adf13c8b tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:47.882558 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-08d8d2a8-0404-47f7-9e69-f740adf13c8b tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] [instance: d49774a5-7f65-4e40-9a54-a51ccb508212] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:47.888671 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-08d8d2a8-0404-47f7-9e69-f740adf13c8b tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:47.889148 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-08d8d2a8-0404-47f7-9e69-f740adf13c8b tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:47.889576 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-08d8d2a8-0404-47f7-9e69-f740adf13c8b tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:47.890312 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-08d8d2a8-0404-47f7-9e69-f740adf13c8b tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:47.891515 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-08d8d2a8-0404-47f7-9e69-f740adf13c8b tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:47.892146 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-08d8d2a8-0404-47f7-9e69-f740adf13c8b tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:47.910970 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell1:SELECT=100 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:56:48.049894 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [req-5a46b1fd-e728-43de-9827-1e5d9f1a240e req-7a45fd47-ac94-4f39-8474-4817cb6c9966 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d49774a5-7f65-4e40-9a54-a51ccb508212", "tag": "4d61ca38-566b-46a3-baab-8d7accb7917f"}]} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:56:48.060197 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-5a46b1fd-e728-43de-9827-1e5d9f1a240e req-7a45fd47-ac94-4f39-8474-4817cb6c9966 service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:48.061169 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-5a46b1fd-e728-43de-9827-1e5d9f1a240e req-7a45fd47-ac94-4f39-8474-4817cb6c9966 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:48.061827 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-5a46b1fd-e728-43de-9827-1e5d9f1a240e req-7a45fd47-ac94-4f39-8474-4817cb6c9966 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:48.077463 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.compute.server_external_events [req-5a46b1fd-e728-43de-9827-1e5d9f1a240e req-7a45fd47-ac94-4f39-8474-4817cb6c9966 service nova] Creating event network-changed:4d61ca38-566b-46a3-baab-8d7accb7917f for instance d49774a5-7f65-4e40-9a54-a51ccb508212 on hv-cinder-84914 Sep 16 01:56:48.082988 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [req-5a46b1fd-e728-43de-9827-1e5d9f1a240e req-7a45fd47-ac94-4f39-8474-4817cb6c9966 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037493 Sep 16 01:56:48.084253 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 198/410] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 01:56:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:56:48.121870 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-08d8d2a8-0404-47f7-9e69-f740adf13c8b tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a194fd36e3024b1f86837cc12ac0c2bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6e7560b314358bd9589ac38b69320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:48.133336 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-08d8d2a8-0404-47f7-9e69-f740adf13c8b tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] 10.222.0.42 "GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212" status: 200 len: 1315 microversion: 2.1 time: 0.255247 Sep 16 01:56:48.133978 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 213/411] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:47 2022] GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212 => generated 1315 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:48.740814 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-bb744f26-a8d5-4108-93b3-e95ee06abfe5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:48.742593 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-bb744f26-a8d5-4108-93b3-e95ee06abfe5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 48c9b577-5e65-464f-9328-da6dc694277c] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:48.751484 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bb744f26-a8d5-4108-93b3-e95ee06abfe5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:48.752281 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bb744f26-a8d5-4108-93b3-e95ee06abfe5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:48.753451 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bb744f26-a8d5-4108-93b3-e95ee06abfe5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:48.755084 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bb744f26-a8d5-4108-93b3-e95ee06abfe5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:48.755658 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bb744f26-a8d5-4108-93b3-e95ee06abfe5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:48.756290 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bb744f26-a8d5-4108-93b3-e95ee06abfe5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:48.940877 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-bb744f26-a8d5-4108-93b3-e95ee06abfe5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:48.952043 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-bb744f26-a8d5-4108-93b3-e95ee06abfe5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c" status: 200 len: 1502 microversion: 2.1 time: 0.216643 Sep 16 01:56:48.954805 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 199/412] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:48 2022] GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c => generated 1502 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:48.977556 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-42c8a300-641a-4600-8847-04a2bd2a2c77 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "deec22d5-4259-4b18-b71e-2b4dbb59a4de"}} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:56:48.980312 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-42c8a300-641a-4600-8847-04a2bd2a2c77 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 48c9b577-5e65-464f-9328-da6dc694277c] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:48.987495 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-42c8a300-641a-4600-8847-04a2bd2a2c77 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:48.988013 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-42c8a300-641a-4600-8847-04a2bd2a2c77 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:48.988491 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-42c8a300-641a-4600-8847-04a2bd2a2c77 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:48.989389 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-42c8a300-641a-4600-8847-04a2bd2a2c77 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:48.990051 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-42c8a300-641a-4600-8847-04a2bd2a2c77 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:48.990719 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-42c8a300-641a-4600-8847-04a2bd2a2c77 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:49.018596 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.wsgi [None req-42c8a300-641a-4600-8847-04a2bd2a2c77 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] HTTP exception thrown: Cannot 'attach_volume' instance 48c9b577-5e65-464f-9328-da6dc694277c while it is in vm_state rescued Sep 16 01:56:49.020733 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-42c8a300-641a-4600-8847-04a2bd2a2c77 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Request method failure captured: Sep 16 01:56:49.020733 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: request: POST /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c/os-volume_attachments HTTP/1.1 Sep 16 01:56:49.020733 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Accept: application/json Sep 16 01:56:49.020733 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Accept-Encoding: identity Sep 16 01:56:49.020733 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Connection: close Sep 16 01:56:49.020733 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Content-Length: 74 Sep 16 01:56:49.020733 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Content-Type: application/json Sep 16 01:56:49.020733 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Host: 10.222.0.42 Sep 16 01:56:49.020733 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Openstack-System-Scope: None Sep 16 01:56:49.020733 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: User-Agent: python-urllib3/1.26.12 Sep 16 01:56:49.020733 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Auth-Token: gAAAAABjI9c-Il8-3hF9Li-IW6ki3rCRxsddmEYj-CEjGwEumw94mpgkrl63sWplgEqXoUz3fiC-3x44O1RRD4kaA9W4JY76zYcpF4adB0c8IXHbjAFOjhvg_wlD1HQTgu9jYX9bvxA4OlQVlK-DbI0GW9oqAmi3IZAroqSCl3VtQWlC8iqMZFo Sep 16 01:56:49.020733 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Domain-Id: None Sep 16 01:56:49.020733 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Domain-Name: None Sep 16 01:56:49.020733 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Identity-Status: Confirmed Sep 16 01:56:49.020733 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Is-Admin-Project: True Sep 16 01:56:49.020733 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Domain-Id: default Sep 16 01:56:49.020733 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Domain-Name: Default Sep 16 01:56:49.020733 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Id: 57aaf234892543698d91303961f14abd Sep 16 01:56:49.020733 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1497504670 Sep 16 01:56:49.020733 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Role: member,reader Sep 16 01:56:49.020733 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Roles: member,reader Sep 16 01:56:49.022047 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/57aaf234892543698d91303961f14abd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/57aaf234892543698d91303961f14abd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_57aaf234892543698d91303961f14abd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/57aaf234892543698d91303961f14abd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 01:56:49.022047 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1497504670 Sep 16 01:56:49.022047 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant-Id: 57aaf234892543698d91303961f14abd Sep 16 01:56:49.022047 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1497504670 Sep 16 01:56:49.022047 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User: tempest-ServerRescueNegativeTestJSON-1497504670-project Sep 16 01:56:49.022047 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Domain-Id: default Sep 16 01:56:49.022047 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Domain-Name: Default Sep 16 01:56:49.022047 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Id: 7eb6ab0644bf4fa59d7bba232d6ccb3c Sep 16 01:56:49.022047 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1497504670-project Sep 16 01:56:49.022047 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Sep 16 01:56:49.022047 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: {"volumeAttachment": {"volumeId": "deec22d5-4259-4b18-b71e-2b4dbb59a4de"}} Sep 16 01:56:49.022047 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: method: > Sep 16 01:56:49.022765 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: exception: Cannot 'attach_volume' instance 48c9b577-5e65-464f-9328-da6dc694277c while it is in vm_state rescued Sep 16 01:56:49.022765 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: action_args: {'server_id': '48c9b577-5e65-464f-9328-da6dc694277c', 'body': {'volumeAttachment': {'volumeId': 'deec22d5-4259-4b18-b71e-2b4dbb59a4de'}}} Sep 16 01:56:49.022765 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 01:56:49.022765 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:56:49.022765 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 16 01:56:49.022765 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 16 01:56:49.022765 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 16 01:56:49.022765 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 16 01:56:49.022765 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 16 01:56:49.022765 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 16 01:56:49.022765 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 48c9b577-5e65-464f-9328-da6dc694277c in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 16 01:56:49.022765 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:56:49.022765 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:56:49.022765 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:56:49.022765 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:56:49.022765 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 01:56:49.022765 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 01:56:49.022765 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 01:56:49.022765 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 01:56:49.024263 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 01:56:49.024263 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 01:56:49.024263 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 01:56:49.024263 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 01:56:49.024263 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 01:56:49.024263 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 01:56:49.024263 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 01:56:49.024263 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 01:56:49.024263 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 16 01:56:49.024263 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 16 01:56:49.024263 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 16 01:56:49.024263 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 16 01:56:49.024263 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 48c9b577-5e65-464f-9328-da6dc694277c while it is in vm_state rescued Sep 16 01:56:49.024263 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:56:49.024263 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:56:49.024263 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:56:49.024263 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:56:49.024263 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 01:56:49.024263 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 01:56:49.025859 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 01:56:49.025859 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 01:56:49.025859 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 48c9b577-5e65-464f-9328-da6dc694277c while it is in vm_state rescued Sep 16 01:56:49.025859 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:56:49.025859 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-42c8a300-641a-4600-8847-04a2bd2a2c77 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Returning 409 to user: Cannot 'attach_volume' instance 48c9b577-5e65-464f-9328-da6dc694277c while it is in vm_state rescued {{(pid=120441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 01:56:49.025859 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-42c8a300-641a-4600-8847-04a2bd2a2c77 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "POST /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.048828 Sep 16 01:56:49.032205 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-5318bdec-ef38-46ad-9b30-245b2cb200a6 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:56:49.032741 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-5318bdec-ef38-46ad-9b30-245b2cb200a6 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 48c9b577-5e65-464f-9328-da6dc694277c] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:49.033217 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 214/413] 10.222.0.42 () {60 vars in 1323 bytes} [Fri Sep 16 01:56:48 2022] POST /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c/os-volume_attachments => generated 152 bytes in 60 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 16 01:56:49.039853 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-5318bdec-ef38-46ad-9b30-245b2cb200a6 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:49.040650 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-5318bdec-ef38-46ad-9b30-245b2cb200a6 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:49.041094 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-5318bdec-ef38-46ad-9b30-245b2cb200a6 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:49.041797 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-5318bdec-ef38-46ad-9b30-245b2cb200a6 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:49.042254 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-5318bdec-ef38-46ad-9b30-245b2cb200a6 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:49.042675 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-5318bdec-ef38-46ad-9b30-245b2cb200a6 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:49.127220 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-5318bdec-ef38-46ad-9b30-245b2cb200a6 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "POST /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c/action" status: 202 len: 0 microversion: 2.1 time: 0.099234 Sep 16 01:56:49.128441 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 200/414] 10.222.0.42 () {60 vars in 1278 bytes} [Fri Sep 16 01:56:49 2022] POST /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c/action => generated 0 bytes in 101 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 01:56:49.139337 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-7c139e81-e0f8-4332-b718-df1a41828eb9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:49.141103 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-7c139e81-e0f8-4332-b718-df1a41828eb9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 48c9b577-5e65-464f-9328-da6dc694277c] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:49.149551 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=3 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:56:49.152091 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7c139e81-e0f8-4332-b718-df1a41828eb9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:49.152807 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7c139e81-e0f8-4332-b718-df1a41828eb9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:49.153250 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7c139e81-e0f8-4332-b718-df1a41828eb9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:49.153952 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7c139e81-e0f8-4332-b718-df1a41828eb9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:49.154566 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7c139e81-e0f8-4332-b718-df1a41828eb9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:49.155148 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7c139e81-e0f8-4332-b718-df1a41828eb9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:49.158359 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-e2e0ea96-8a3b-494e-bddb-a9a7fd6a087f tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:49.159472 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-e2e0ea96-8a3b-494e-bddb-a9a7fd6a087f tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] [instance: d49774a5-7f65-4e40-9a54-a51ccb508212] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:49.166954 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e2e0ea96-8a3b-494e-bddb-a9a7fd6a087f tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:49.167889 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e2e0ea96-8a3b-494e-bddb-a9a7fd6a087f tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:49.169630 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e2e0ea96-8a3b-494e-bddb-a9a7fd6a087f tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:49.170553 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e2e0ea96-8a3b-494e-bddb-a9a7fd6a087f tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:49.171204 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e2e0ea96-8a3b-494e-bddb-a9a7fd6a087f tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:49.173018 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e2e0ea96-8a3b-494e-bddb-a9a7fd6a087f tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:49.389316 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-e2e0ea96-8a3b-494e-bddb-a9a7fd6a087f tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a194fd36e3024b1f86837cc12ac0c2bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6e7560b314358bd9589ac38b69320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:49.400895 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-e2e0ea96-8a3b-494e-bddb-a9a7fd6a087f tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] 10.222.0.42 "GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212" status: 200 len: 1315 microversion: 2.1 time: 0.247908 Sep 16 01:56:49.402153 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 201/415] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:49 2022] GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212 => generated 1315 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:49.413540 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-7c139e81-e0f8-4332-b718-df1a41828eb9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:49.423570 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-7c139e81-e0f8-4332-b718-df1a41828eb9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c" status: 200 len: 1510 microversion: 2.1 time: 0.289872 Sep 16 01:56:49.424309 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 215/416] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:49 2022] GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c => generated 1510 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:50.428106 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-3fbeca54-a967-445d-9d65-3f118fccd99a tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:50.429477 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-3fbeca54-a967-445d-9d65-3f118fccd99a tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] [instance: d49774a5-7f65-4e40-9a54-a51ccb508212] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:50.436708 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3fbeca54-a967-445d-9d65-3f118fccd99a tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:50.437534 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3fbeca54-a967-445d-9d65-3f118fccd99a tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:50.438414 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3fbeca54-a967-445d-9d65-3f118fccd99a tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:50.439387 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3fbeca54-a967-445d-9d65-3f118fccd99a tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:50.440127 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3fbeca54-a967-445d-9d65-3f118fccd99a tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:50.440726 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3fbeca54-a967-445d-9d65-3f118fccd99a tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:50.449867 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-a6f40bf4-65ba-4a0d-8e3e-d21a4a0d832c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:50.450649 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-a6f40bf4-65ba-4a0d-8e3e-d21a4a0d832c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 48c9b577-5e65-464f-9328-da6dc694277c] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:50.457395 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a6f40bf4-65ba-4a0d-8e3e-d21a4a0d832c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:50.460048 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a6f40bf4-65ba-4a0d-8e3e-d21a4a0d832c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:50.460674 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a6f40bf4-65ba-4a0d-8e3e-d21a4a0d832c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:50.472087 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a6f40bf4-65ba-4a0d-8e3e-d21a4a0d832c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:50.472610 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a6f40bf4-65ba-4a0d-8e3e-d21a4a0d832c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:50.473055 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a6f40bf4-65ba-4a0d-8e3e-d21a4a0d832c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:50.630779 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-3fbeca54-a967-445d-9d65-3f118fccd99a tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a194fd36e3024b1f86837cc12ac0c2bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6e7560b314358bd9589ac38b69320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:50.644499 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-3fbeca54-a967-445d-9d65-3f118fccd99a tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] 10.222.0.42 "GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212" status: 200 len: 1315 microversion: 2.1 time: 0.223232 Sep 16 01:56:50.656792 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 202/417] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:50 2022] GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212 => generated 1315 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:50.669516 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-a6f40bf4-65ba-4a0d-8e3e-d21a4a0d832c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:50.678824 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-a6f40bf4-65ba-4a0d-8e3e-d21a4a0d832c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c" status: 200 len: 1510 microversion: 2.1 time: 0.232945 Sep 16 01:56:50.679441 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 216/418] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:50 2022] GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c => generated 1510 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:51.670959 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-47db6a6c-a018-4c9c-ae3d-9df92be659bd tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:51.673266 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-47db6a6c-a018-4c9c-ae3d-9df92be659bd tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] [instance: d49774a5-7f65-4e40-9a54-a51ccb508212] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:51.680124 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-47db6a6c-a018-4c9c-ae3d-9df92be659bd tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:51.680754 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-47db6a6c-a018-4c9c-ae3d-9df92be659bd tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:51.681391 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-47db6a6c-a018-4c9c-ae3d-9df92be659bd tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:51.682124 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-47db6a6c-a018-4c9c-ae3d-9df92be659bd tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:51.682789 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-47db6a6c-a018-4c9c-ae3d-9df92be659bd tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:51.683429 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-47db6a6c-a018-4c9c-ae3d-9df92be659bd tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:51.710889 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-c264e977-5800-40a5-8a3f-a5c1471e5478 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:51.712080 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-c264e977-5800-40a5-8a3f-a5c1471e5478 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 48c9b577-5e65-464f-9328-da6dc694277c] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:51.725410 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c264e977-5800-40a5-8a3f-a5c1471e5478 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:51.726277 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c264e977-5800-40a5-8a3f-a5c1471e5478 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:51.726970 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c264e977-5800-40a5-8a3f-a5c1471e5478 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:51.727899 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c264e977-5800-40a5-8a3f-a5c1471e5478 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:51.728503 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c264e977-5800-40a5-8a3f-a5c1471e5478 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:51.729030 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c264e977-5800-40a5-8a3f-a5c1471e5478 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:51.900828 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-47db6a6c-a018-4c9c-ae3d-9df92be659bd tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a194fd36e3024b1f86837cc12ac0c2bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6e7560b314358bd9589ac38b69320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:51.911573 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-47db6a6c-a018-4c9c-ae3d-9df92be659bd tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] 10.222.0.42 "GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212" status: 200 len: 1315 microversion: 2.1 time: 0.245851 Sep 16 01:56:51.926995 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 203/419] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:51 2022] GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212 => generated 1315 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 01:56:51.929924 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-c264e977-5800-40a5-8a3f-a5c1471e5478 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:51.938394 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-c264e977-5800-40a5-8a3f-a5c1471e5478 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c" status: 200 len: 1510 microversion: 2.1 time: 0.231379 Sep 16 01:56:51.939025 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 217/420] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:51 2022] GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c => generated 1510 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 01:56:52.934702 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-bc3cda38-a9b5-44d8-8ce5-9c0709b03923 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:52.935322 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-bc3cda38-a9b5-44d8-8ce5-9c0709b03923 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] [instance: d49774a5-7f65-4e40-9a54-a51ccb508212] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:52.963161 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-dc6ee5fb-bb20-43a8-badf-4b2eeabe9f85 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:52.964507 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-dc6ee5fb-bb20-43a8-badf-4b2eeabe9f85 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 48c9b577-5e65-464f-9328-da6dc694277c] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:52.977334 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bc3cda38-a9b5-44d8-8ce5-9c0709b03923 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:52.979582 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-dc6ee5fb-bb20-43a8-badf-4b2eeabe9f85 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:52.980119 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-dc6ee5fb-bb20-43a8-badf-4b2eeabe9f85 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:52.980562 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-dc6ee5fb-bb20-43a8-badf-4b2eeabe9f85 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:52.981281 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-dc6ee5fb-bb20-43a8-badf-4b2eeabe9f85 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:52.981739 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-dc6ee5fb-bb20-43a8-badf-4b2eeabe9f85 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:52.982168 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-dc6ee5fb-bb20-43a8-badf-4b2eeabe9f85 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:52.984326 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bc3cda38-a9b5-44d8-8ce5-9c0709b03923 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.022s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:52.985683 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bc3cda38-a9b5-44d8-8ce5-9c0709b03923 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:52.986445 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bc3cda38-a9b5-44d8-8ce5-9c0709b03923 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:52.987106 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bc3cda38-a9b5-44d8-8ce5-9c0709b03923 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:52.987544 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bc3cda38-a9b5-44d8-8ce5-9c0709b03923 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:53.209096 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-bc3cda38-a9b5-44d8-8ce5-9c0709b03923 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a194fd36e3024b1f86837cc12ac0c2bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6e7560b314358bd9589ac38b69320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:53.217673 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-bc3cda38-a9b5-44d8-8ce5-9c0709b03923 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] 10.222.0.42 "GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212" status: 200 len: 1315 microversion: 2.1 time: 0.286886 Sep 16 01:56:53.218416 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 204/421] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:52 2022] GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212 => generated 1315 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:53.456365 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-dc6ee5fb-bb20-43a8-badf-4b2eeabe9f85 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:53.467502 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-dc6ee5fb-bb20-43a8-badf-4b2eeabe9f85 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c" status: 200 len: 1510 microversion: 2.1 time: 0.508627 Sep 16 01:56:53.468141 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 218/422] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:52 2022] GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c => generated 1510 bytes in 510 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 01:56:54.242925 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-1f2f14f0-bbc7-4fbd-928e-47202500e0d6 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:54.243622 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-1f2f14f0-bbc7-4fbd-928e-47202500e0d6 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] [instance: d49774a5-7f65-4e40-9a54-a51ccb508212] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:54.251143 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1f2f14f0-bbc7-4fbd-928e-47202500e0d6 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:54.251641 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1f2f14f0-bbc7-4fbd-928e-47202500e0d6 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:54.252110 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1f2f14f0-bbc7-4fbd-928e-47202500e0d6 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:54.252829 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1f2f14f0-bbc7-4fbd-928e-47202500e0d6 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:54.253290 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1f2f14f0-bbc7-4fbd-928e-47202500e0d6 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:54.253973 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1f2f14f0-bbc7-4fbd-928e-47202500e0d6 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:54.430812 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-1f2f14f0-bbc7-4fbd-928e-47202500e0d6 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a194fd36e3024b1f86837cc12ac0c2bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6e7560b314358bd9589ac38b69320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:54.439272 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-1f2f14f0-bbc7-4fbd-928e-47202500e0d6 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] 10.222.0.42 "GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212" status: 200 len: 1315 microversion: 2.1 time: 0.200233 Sep 16 01:56:54.439837 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 205/423] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:54 2022] GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212 => generated 1315 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 01:56:54.508462 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-bbf0222a-d9f8-48a8-806e-b450683df2cc tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:54.510206 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-bbf0222a-d9f8-48a8-806e-b450683df2cc tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 48c9b577-5e65-464f-9328-da6dc694277c] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:54.517572 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-bbf0222a-d9f8-48a8-806e-b450683df2cc tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:54.518071 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-bbf0222a-d9f8-48a8-806e-b450683df2cc tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:54.518503 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-bbf0222a-d9f8-48a8-806e-b450683df2cc tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:54.519385 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-bbf0222a-d9f8-48a8-806e-b450683df2cc tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:54.520338 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-bbf0222a-d9f8-48a8-806e-b450683df2cc tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:54.520922 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-bbf0222a-d9f8-48a8-806e-b450683df2cc tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:54.719963 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-bbf0222a-d9f8-48a8-806e-b450683df2cc tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:54.740316 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-bbf0222a-d9f8-48a8-806e-b450683df2cc tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c" status: 200 len: 1510 microversion: 2.1 time: 0.232223 Sep 16 01:56:54.741093 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 219/424] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:54 2022] GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c => generated 1510 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:55.464921 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-9747a23c-ef75-43cd-afac-6bf5a67f3487 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:55.466551 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-9747a23c-ef75-43cd-afac-6bf5a67f3487 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] [instance: d49774a5-7f65-4e40-9a54-a51ccb508212] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:55.476649 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9747a23c-ef75-43cd-afac-6bf5a67f3487 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:55.477600 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9747a23c-ef75-43cd-afac-6bf5a67f3487 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:55.478318 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9747a23c-ef75-43cd-afac-6bf5a67f3487 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:55.479224 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9747a23c-ef75-43cd-afac-6bf5a67f3487 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:55.479954 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9747a23c-ef75-43cd-afac-6bf5a67f3487 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:55.480777 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9747a23c-ef75-43cd-afac-6bf5a67f3487 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:55.646300 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-9747a23c-ef75-43cd-afac-6bf5a67f3487 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a194fd36e3024b1f86837cc12ac0c2bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6e7560b314358bd9589ac38b69320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:55.655138 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-9747a23c-ef75-43cd-afac-6bf5a67f3487 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] 10.222.0.42 "GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212" status: 200 len: 1315 microversion: 2.1 time: 0.195652 Sep 16 01:56:55.670887 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 206/425] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:55 2022] GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212 => generated 1315 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:55.766728 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-fa9755ce-fb26-49c1-a222-17454dff830b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:55.767358 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-fa9755ce-fb26-49c1-a222-17454dff830b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 48c9b577-5e65-464f-9328-da6dc694277c] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:55.773771 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fa9755ce-fb26-49c1-a222-17454dff830b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:55.774506 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fa9755ce-fb26-49c1-a222-17454dff830b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:55.775167 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fa9755ce-fb26-49c1-a222-17454dff830b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:55.776010 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fa9755ce-fb26-49c1-a222-17454dff830b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:55.776718 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fa9755ce-fb26-49c1-a222-17454dff830b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:55.777203 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fa9755ce-fb26-49c1-a222-17454dff830b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:55.939985 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-fa9755ce-fb26-49c1-a222-17454dff830b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:55.947433 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-fa9755ce-fb26-49c1-a222-17454dff830b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c" status: 200 len: 1510 microversion: 2.1 time: 0.184659 Sep 16 01:56:55.948029 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 220/426] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:55 2022] GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c => generated 1510 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:56.679853 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-bb290aa7-d065-4093-afa1-6b51c610b835 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:56.680615 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-bb290aa7-d065-4093-afa1-6b51c610b835 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] [instance: d49774a5-7f65-4e40-9a54-a51ccb508212] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:56.691223 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bb290aa7-d065-4093-afa1-6b51c610b835 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:56.692127 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bb290aa7-d065-4093-afa1-6b51c610b835 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:56.692691 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bb290aa7-d065-4093-afa1-6b51c610b835 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:56.693508 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bb290aa7-d065-4093-afa1-6b51c610b835 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:56.694055 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bb290aa7-d065-4093-afa1-6b51c610b835 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:56.694681 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bb290aa7-d065-4093-afa1-6b51c610b835 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:56.844939 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-bb290aa7-d065-4093-afa1-6b51c610b835 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a194fd36e3024b1f86837cc12ac0c2bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6e7560b314358bd9589ac38b69320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:56.853165 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-bb290aa7-d065-4093-afa1-6b51c610b835 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] 10.222.0.42 "GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212" status: 200 len: 1315 microversion: 2.1 time: 0.178915 Sep 16 01:56:56.855991 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 207/427] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:56 2022] GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:56.971980 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-f698ef7e-4ee3-4594-b3c2-9070cd0cc0e5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:56.973231 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-f698ef7e-4ee3-4594-b3c2-9070cd0cc0e5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 48c9b577-5e65-464f-9328-da6dc694277c] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:56.979454 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f698ef7e-4ee3-4594-b3c2-9070cd0cc0e5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:56.979957 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f698ef7e-4ee3-4594-b3c2-9070cd0cc0e5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:56.980414 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f698ef7e-4ee3-4594-b3c2-9070cd0cc0e5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:56.981108 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f698ef7e-4ee3-4594-b3c2-9070cd0cc0e5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:56.981556 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f698ef7e-4ee3-4594-b3c2-9070cd0cc0e5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:56.982037 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f698ef7e-4ee3-4594-b3c2-9070cd0cc0e5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:57.125971 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-f698ef7e-4ee3-4594-b3c2-9070cd0cc0e5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:57.134129 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-f698ef7e-4ee3-4594-b3c2-9070cd0cc0e5 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c" status: 200 len: 1510 microversion: 2.1 time: 0.167093 Sep 16 01:56:57.135106 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 221/428] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:56 2022] GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c => generated 1510 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:57.881230 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-62a08369-2347-4965-8293-56c8e619a8ed tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:57.882476 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-62a08369-2347-4965-8293-56c8e619a8ed tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] [instance: d49774a5-7f65-4e40-9a54-a51ccb508212] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:57.891670 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-62a08369-2347-4965-8293-56c8e619a8ed tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:57.892473 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-62a08369-2347-4965-8293-56c8e619a8ed tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:57.893134 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-62a08369-2347-4965-8293-56c8e619a8ed tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:57.894687 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-62a08369-2347-4965-8293-56c8e619a8ed tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:57.895324 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-62a08369-2347-4965-8293-56c8e619a8ed tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:57.896103 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-62a08369-2347-4965-8293-56c8e619a8ed tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:58.051101 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-62a08369-2347-4965-8293-56c8e619a8ed tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a194fd36e3024b1f86837cc12ac0c2bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6e7560b314358bd9589ac38b69320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:58.059683 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-62a08369-2347-4965-8293-56c8e619a8ed tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] 10.222.0.42 "GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212" status: 200 len: 1315 microversion: 2.1 time: 0.183256 Sep 16 01:56:58.060471 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 208/429] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:57 2022] GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212 => generated 1315 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:58.159240 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-aebfa764-4ed8-4fd2-bdee-864a822969f8 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:58.159860 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-aebfa764-4ed8-4fd2-bdee-864a822969f8 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 48c9b577-5e65-464f-9328-da6dc694277c] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:58.165794 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-aebfa764-4ed8-4fd2-bdee-864a822969f8 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:58.166273 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-aebfa764-4ed8-4fd2-bdee-864a822969f8 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:58.166968 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-aebfa764-4ed8-4fd2-bdee-864a822969f8 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:58.167729 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-aebfa764-4ed8-4fd2-bdee-864a822969f8 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:58.168258 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-aebfa764-4ed8-4fd2-bdee-864a822969f8 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:58.168933 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-aebfa764-4ed8-4fd2-bdee-864a822969f8 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:58.313318 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-aebfa764-4ed8-4fd2-bdee-864a822969f8 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:58.321800 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-aebfa764-4ed8-4fd2-bdee-864a822969f8 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c" status: 200 len: 1510 microversion: 2.1 time: 0.167448 Sep 16 01:56:58.322377 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 222/430] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:58 2022] GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c => generated 1510 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:59.083542 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-bc2d4a75-f429-400f-9acd-e0ddd33ece21 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:59.084151 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-bc2d4a75-f429-400f-9acd-e0ddd33ece21 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] [instance: d49774a5-7f65-4e40-9a54-a51ccb508212] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:59.088096 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_api:SELECT=65,nova_api:UPDATE=1 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:56:59.091737 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bc2d4a75-f429-400f-9acd-e0ddd33ece21 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:59.092367 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bc2d4a75-f429-400f-9acd-e0ddd33ece21 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:59.093049 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bc2d4a75-f429-400f-9acd-e0ddd33ece21 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:59.094162 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bc2d4a75-f429-400f-9acd-e0ddd33ece21 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:59.094637 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bc2d4a75-f429-400f-9acd-e0ddd33ece21 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:59.095080 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bc2d4a75-f429-400f-9acd-e0ddd33ece21 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:59.234102 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-bc2d4a75-f429-400f-9acd-e0ddd33ece21 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a194fd36e3024b1f86837cc12ac0c2bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6e7560b314358bd9589ac38b69320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:59.242713 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-bc2d4a75-f429-400f-9acd-e0ddd33ece21 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] 10.222.0.42 "GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212" status: 200 len: 1315 microversion: 2.1 time: 0.163319 Sep 16 01:56:59.243897 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 209/431] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:59 2022] GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212 => generated 1315 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:56:59.347871 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-50e4968e-6775-4792-8ccf-1895482f7025 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:56:59.348475 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-50e4968e-6775-4792-8ccf-1895482f7025 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 48c9b577-5e65-464f-9328-da6dc694277c] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:56:59.354774 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-50e4968e-6775-4792-8ccf-1895482f7025 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:59.355283 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-50e4968e-6775-4792-8ccf-1895482f7025 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:59.355700 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-50e4968e-6775-4792-8ccf-1895482f7025 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:59.356622 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-50e4968e-6775-4792-8ccf-1895482f7025 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:56:59.357077 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-50e4968e-6775-4792-8ccf-1895482f7025 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:56:59.357503 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-50e4968e-6775-4792-8ccf-1895482f7025 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:56:59.498395 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-50e4968e-6775-4792-8ccf-1895482f7025 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:56:59.507868 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-50e4968e-6775-4792-8ccf-1895482f7025 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c" status: 200 len: 1510 microversion: 2.1 time: 0.163953 Sep 16 01:56:59.511971 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 223/432] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:56:59 2022] GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c => generated 1510 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:57:00.267470 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-beddf011-68a0-4590-947b-b5dd4042ab7a tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:00.268779 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-beddf011-68a0-4590-947b-b5dd4042ab7a tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] [instance: d49774a5-7f65-4e40-9a54-a51ccb508212] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:00.275352 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-beddf011-68a0-4590-947b-b5dd4042ab7a tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:00.276216 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-beddf011-68a0-4590-947b-b5dd4042ab7a tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:00.276839 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-beddf011-68a0-4590-947b-b5dd4042ab7a tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:00.277922 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-beddf011-68a0-4590-947b-b5dd4042ab7a tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:00.278451 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-beddf011-68a0-4590-947b-b5dd4042ab7a tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:00.278953 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-beddf011-68a0-4590-947b-b5dd4042ab7a tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:00.299300 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:57:00.435043 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-beddf011-68a0-4590-947b-b5dd4042ab7a tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a194fd36e3024b1f86837cc12ac0c2bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6e7560b314358bd9589ac38b69320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:00.447245 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-beddf011-68a0-4590-947b-b5dd4042ab7a tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] 10.222.0.42 "GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212" status: 200 len: 1315 microversion: 2.1 time: 0.184021 Sep 16 01:57:00.448038 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 210/433] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:57:00 2022] GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212 => generated 1315 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:57:00.531902 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-07c696a8-654d-408b-acca-f4f733e0a524 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:00.532675 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-07c696a8-654d-408b-acca-f4f733e0a524 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 48c9b577-5e65-464f-9328-da6dc694277c] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:00.538941 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-07c696a8-654d-408b-acca-f4f733e0a524 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:00.539440 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-07c696a8-654d-408b-acca-f4f733e0a524 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:00.539877 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-07c696a8-654d-408b-acca-f4f733e0a524 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:00.540622 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-07c696a8-654d-408b-acca-f4f733e0a524 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:00.541076 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-07c696a8-654d-408b-acca-f4f733e0a524 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:00.541505 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-07c696a8-654d-408b-acca-f4f733e0a524 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:00.688386 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-07c696a8-654d-408b-acca-f4f733e0a524 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:00.696035 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-07c696a8-654d-408b-acca-f4f733e0a524 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c" status: 200 len: 1510 microversion: 2.1 time: 0.168384 Sep 16 01:57:00.696599 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 224/434] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:57:00 2022] GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c => generated 1510 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:57:01.484248 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-6ba82704-423a-40f0-89df-f6646ecd7326 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:01.485175 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-6ba82704-423a-40f0-89df-f6646ecd7326 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] [instance: d49774a5-7f65-4e40-9a54-a51ccb508212] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:01.494214 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6ba82704-423a-40f0-89df-f6646ecd7326 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:01.494729 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6ba82704-423a-40f0-89df-f6646ecd7326 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:01.495220 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6ba82704-423a-40f0-89df-f6646ecd7326 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:01.496198 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6ba82704-423a-40f0-89df-f6646ecd7326 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:01.496825 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6ba82704-423a-40f0-89df-f6646ecd7326 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:01.497245 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6ba82704-423a-40f0-89df-f6646ecd7326 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:01.702678 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-6ba82704-423a-40f0-89df-f6646ecd7326 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a194fd36e3024b1f86837cc12ac0c2bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6e7560b314358bd9589ac38b69320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:01.722193 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-0c23d408-dc48-43ff-a78c-544d9ad8019b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:01.723494 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-0c23d408-dc48-43ff-a78c-544d9ad8019b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 48c9b577-5e65-464f-9328-da6dc694277c] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:01.729544 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-6ba82704-423a-40f0-89df-f6646ecd7326 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] 10.222.0.42 "GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212" status: 200 len: 1315 microversion: 2.1 time: 0.261805 Sep 16 01:57:01.743726 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0c23d408-dc48-43ff-a78c-544d9ad8019b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:01.744271 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 211/435] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:57:01 2022] GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212 => generated 1315 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:57:01.744851 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0c23d408-dc48-43ff-a78c-544d9ad8019b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:01.745423 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0c23d408-dc48-43ff-a78c-544d9ad8019b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:01.746389 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0c23d408-dc48-43ff-a78c-544d9ad8019b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:01.746949 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0c23d408-dc48-43ff-a78c-544d9ad8019b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:01.747766 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0c23d408-dc48-43ff-a78c-544d9ad8019b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:02.085912 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-0c23d408-dc48-43ff-a78c-544d9ad8019b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:02.098055 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-0c23d408-dc48-43ff-a78c-544d9ad8019b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c" status: 200 len: 1510 microversion: 2.1 time: 0.378575 Sep 16 01:57:02.098919 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 225/436] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:57:01 2022] GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c => generated 1510 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 01:57:02.766166 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-2e0ad0c9-cd5c-45e0-b4bd-7d2f2218086a tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:02.767489 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-2e0ad0c9-cd5c-45e0-b4bd-7d2f2218086a tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] [instance: d49774a5-7f65-4e40-9a54-a51ccb508212] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:02.777629 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2e0ad0c9-cd5c-45e0-b4bd-7d2f2218086a tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:02.778593 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2e0ad0c9-cd5c-45e0-b4bd-7d2f2218086a tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:02.779146 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2e0ad0c9-cd5c-45e0-b4bd-7d2f2218086a tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:02.780357 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2e0ad0c9-cd5c-45e0-b4bd-7d2f2218086a tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:02.781191 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2e0ad0c9-cd5c-45e0-b4bd-7d2f2218086a tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:02.781932 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2e0ad0c9-cd5c-45e0-b4bd-7d2f2218086a tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:02.933558 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-2e0ad0c9-cd5c-45e0-b4bd-7d2f2218086a tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a194fd36e3024b1f86837cc12ac0c2bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6e7560b314358bd9589ac38b69320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:02.945368 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-2e0ad0c9-cd5c-45e0-b4bd-7d2f2218086a tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] 10.222.0.42 "GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212" status: 200 len: 1315 microversion: 2.1 time: 0.186244 Sep 16 01:57:02.946727 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 212/437] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:57:02 2022] GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:57:03.125156 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-e17970fc-6898-4316-972d-d91e04a11fba tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:03.125828 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-e17970fc-6898-4316-972d-d91e04a11fba tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 48c9b577-5e65-464f-9328-da6dc694277c] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:03.132848 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e17970fc-6898-4316-972d-d91e04a11fba tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:03.133436 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e17970fc-6898-4316-972d-d91e04a11fba tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:03.133996 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e17970fc-6898-4316-972d-d91e04a11fba tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:03.134718 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e17970fc-6898-4316-972d-d91e04a11fba tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:03.135007 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e17970fc-6898-4316-972d-d91e04a11fba tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:03.135427 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e17970fc-6898-4316-972d-d91e04a11fba tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:03.290267 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-e17970fc-6898-4316-972d-d91e04a11fba tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:03.299962 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-e17970fc-6898-4316-972d-d91e04a11fba tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c" status: 200 len: 1510 microversion: 2.1 time: 0.178900 Sep 16 01:57:03.304551 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 226/438] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:57:03 2022] GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c => generated 1510 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:57:03.969300 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-8446bd26-1dc8-4722-87bc-be440c730d00 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:03.970084 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-8446bd26-1dc8-4722-87bc-be440c730d00 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] [instance: d49774a5-7f65-4e40-9a54-a51ccb508212] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:03.990465 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8446bd26-1dc8-4722-87bc-be440c730d00 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:03.991487 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8446bd26-1dc8-4722-87bc-be440c730d00 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:03.992174 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8446bd26-1dc8-4722-87bc-be440c730d00 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:03.993124 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8446bd26-1dc8-4722-87bc-be440c730d00 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:03.993563 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8446bd26-1dc8-4722-87bc-be440c730d00 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:03.994070 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8446bd26-1dc8-4722-87bc-be440c730d00 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:04.167254 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-8446bd26-1dc8-4722-87bc-be440c730d00 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a194fd36e3024b1f86837cc12ac0c2bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6e7560b314358bd9589ac38b69320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:04.177150 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-8446bd26-1dc8-4722-87bc-be440c730d00 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] 10.222.0.42 "GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212" status: 200 len: 1315 microversion: 2.1 time: 0.212043 Sep 16 01:57:04.179960 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 213/439] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:57:03 2022] GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212 => generated 1315 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:57:04.195424 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [req-c150035d-a104-4d36-87e4-c0c79b6471a8 req-9c4cbc0b-1bc0-4414-8d06-a2b267dae3bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d49774a5-7f65-4e40-9a54-a51ccb508212", "name": "network-vif-plugged", "status": "completed", "tag": "4d61ca38-566b-46a3-baab-8d7accb7917f"}]} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:57:04.207812 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-c150035d-a104-4d36-87e4-c0c79b6471a8 req-9c4cbc0b-1bc0-4414-8d06-a2b267dae3bc service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:04.208534 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-c150035d-a104-4d36-87e4-c0c79b6471a8 req-9c4cbc0b-1bc0-4414-8d06-a2b267dae3bc service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:04.209139 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-c150035d-a104-4d36-87e4-c0c79b6471a8 req-9c4cbc0b-1bc0-4414-8d06-a2b267dae3bc service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:04.221964 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.compute.server_external_events [req-c150035d-a104-4d36-87e4-c0c79b6471a8 req-9c4cbc0b-1bc0-4414-8d06-a2b267dae3bc service nova] Creating event network-vif-plugged:4d61ca38-566b-46a3-baab-8d7accb7917f for instance d49774a5-7f65-4e40-9a54-a51ccb508212 on hv-cinder-84914 Sep 16 01:57:04.227376 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [req-c150035d-a104-4d36-87e4-c0c79b6471a8 req-9c4cbc0b-1bc0-4414-8d06-a2b267dae3bc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036875 Sep 16 01:57:04.229159 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 227/440] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 01:57:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:57:04.325199 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-cfa5865f-2e89-4e78-9af8-8e8b6bba4ef6 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:04.326109 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-cfa5865f-2e89-4e78-9af8-8e8b6bba4ef6 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 48c9b577-5e65-464f-9328-da6dc694277c] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:04.336747 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cfa5865f-2e89-4e78-9af8-8e8b6bba4ef6 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:04.337616 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cfa5865f-2e89-4e78-9af8-8e8b6bba4ef6 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:04.338324 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cfa5865f-2e89-4e78-9af8-8e8b6bba4ef6 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:04.339289 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cfa5865f-2e89-4e78-9af8-8e8b6bba4ef6 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:04.339992 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cfa5865f-2e89-4e78-9af8-8e8b6bba4ef6 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:04.340665 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cfa5865f-2e89-4e78-9af8-8e8b6bba4ef6 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:04.531902 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-cfa5865f-2e89-4e78-9af8-8e8b6bba4ef6 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:04.541955 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-cfa5865f-2e89-4e78-9af8-8e8b6bba4ef6 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c" status: 200 len: 1510 microversion: 2.1 time: 0.219850 Sep 16 01:57:04.543150 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 214/441] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:57:04 2022] GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c => generated 1510 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:57:05.200975 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-faf6fcd1-d492-419c-9e9a-76625e17b4e8 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:05.201673 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-faf6fcd1-d492-419c-9e9a-76625e17b4e8 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] [instance: d49774a5-7f65-4e40-9a54-a51ccb508212] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:05.208684 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-faf6fcd1-d492-419c-9e9a-76625e17b4e8 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:05.209160 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-faf6fcd1-d492-419c-9e9a-76625e17b4e8 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:05.209588 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-faf6fcd1-d492-419c-9e9a-76625e17b4e8 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:05.210265 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-faf6fcd1-d492-419c-9e9a-76625e17b4e8 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:05.210713 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-faf6fcd1-d492-419c-9e9a-76625e17b4e8 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:05.211131 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-faf6fcd1-d492-419c-9e9a-76625e17b4e8 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:05.340905 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-faf6fcd1-d492-419c-9e9a-76625e17b4e8 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a194fd36e3024b1f86837cc12ac0c2bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6e7560b314358bd9589ac38b69320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:05.348753 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-faf6fcd1-d492-419c-9e9a-76625e17b4e8 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] 10.222.0.42 "GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212" status: 200 len: 1315 microversion: 2.1 time: 0.152112 Sep 16 01:57:05.349309 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 228/442] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:57:05 2022] GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212 => generated 1315 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:57:05.566343 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-715bb198-dfce-4b06-a17a-660a7f589950 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:05.566952 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-715bb198-dfce-4b06-a17a-660a7f589950 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 48c9b577-5e65-464f-9328-da6dc694277c] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:05.573584 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-715bb198-dfce-4b06-a17a-660a7f589950 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:05.574061 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-715bb198-dfce-4b06-a17a-660a7f589950 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:05.574494 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-715bb198-dfce-4b06-a17a-660a7f589950 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:05.575177 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-715bb198-dfce-4b06-a17a-660a7f589950 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:05.575626 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-715bb198-dfce-4b06-a17a-660a7f589950 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:05.576088 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-715bb198-dfce-4b06-a17a-660a7f589950 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:05.716614 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-715bb198-dfce-4b06-a17a-660a7f589950 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:05.726202 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-715bb198-dfce-4b06-a17a-660a7f589950 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c" status: 200 len: 1516 microversion: 2.1 time: 0.163586 Sep 16 01:57:05.726769 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 215/443] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:57:05 2022] GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c => generated 1516 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:57:06.372544 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-b7302d99-6b97-450b-aca7-bf553c7059a8 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:06.373149 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-b7302d99-6b97-450b-aca7-bf553c7059a8 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] [instance: d49774a5-7f65-4e40-9a54-a51ccb508212] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:06.380311 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b7302d99-6b97-450b-aca7-bf553c7059a8 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:06.380786 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b7302d99-6b97-450b-aca7-bf553c7059a8 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:06.381307 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b7302d99-6b97-450b-aca7-bf553c7059a8 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:06.382051 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b7302d99-6b97-450b-aca7-bf553c7059a8 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:06.382501 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b7302d99-6b97-450b-aca7-bf553c7059a8 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:06.382918 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b7302d99-6b97-450b-aca7-bf553c7059a8 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:06.523793 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-b7302d99-6b97-450b-aca7-bf553c7059a8 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a194fd36e3024b1f86837cc12ac0c2bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6e7560b314358bd9589ac38b69320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:06.534066 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-b7302d99-6b97-450b-aca7-bf553c7059a8 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] 10.222.0.42 "GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212" status: 200 len: 1315 microversion: 2.1 time: 0.166045 Sep 16 01:57:06.534822 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 229/444] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:57:06 2022] GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212 => generated 1315 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:57:07.111872 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-fbcdcac7-0f4f-432e-9824-0f6d906f0b8a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Action: 'create', calling method: .version_select at 0x7fae32d8ac10>, body: {"keypair": {"name": "tempest-keypair-1164743971", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFDkRiyctfSy5R0tf8k8zcB8rpqNJifNlADDotfkgVDKaeaHYhH/nBOWw/g4bqxPQTfVY/3tWv1UsVJiUqZ9tFPCwespOUVyxdRc4t8kcF8ICCCsGkE5ALVf9JQdhIknGA=="}} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:57:07.134383 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.quota [None req-fbcdcac7-0f4f-432e-9824-0f6d906f0b8a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Getting quotas for project 57aaf234892543698d91303961f14abd. Resources: {'key_pairs'} {{(pid=120440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 01:57:07.138848 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.quota [None req-fbcdcac7-0f4f-432e-9824-0f6d906f0b8a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Getting quotas for user 7eb6ab0644bf4fa59d7bba232d6ccb3c and project 57aaf234892543698d91303961f14abd. Resources: {'key_pairs'} {{(pid=120440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 01:57:07.187740 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-fbcdcac7-0f4f-432e-9824-0f6d906f0b8a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.080174 Sep 16 01:57:07.188394 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 216/445] 10.222.0.42 () {60 vars in 1159 bytes} [Fri Sep 16 01:57:07 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:57:07.617365 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-28d32ce4-eeb7-40fa-8762-3b23062b7478 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:07.618962 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-28d32ce4-eeb7-40fa-8762-3b23062b7478 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] [instance: d49774a5-7f65-4e40-9a54-a51ccb508212] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:07.627077 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-28d32ce4-eeb7-40fa-8762-3b23062b7478 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:07.627703 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-28d32ce4-eeb7-40fa-8762-3b23062b7478 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:07.628195 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-28d32ce4-eeb7-40fa-8762-3b23062b7478 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:07.629577 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-28d32ce4-eeb7-40fa-8762-3b23062b7478 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:07.630285 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-28d32ce4-eeb7-40fa-8762-3b23062b7478 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:07.630976 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-28d32ce4-eeb7-40fa-8762-3b23062b7478 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:07.796541 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-28d32ce4-eeb7-40fa-8762-3b23062b7478 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a194fd36e3024b1f86837cc12ac0c2bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6e7560b314358bd9589ac38b69320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:07.804966 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-28d32ce4-eeb7-40fa-8762-3b23062b7478 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] 10.222.0.42 "GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212" status: 200 len: 1315 microversion: 2.1 time: 0.191594 Sep 16 01:57:07.805743 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 230/446] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:57:07 2022] GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212 => generated 1315 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:57:08.593017 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-54838cdd-a444-4a11-a3c3-79e5e81b9e73 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1398430031", "imageRef": "1546da04-912c-44c6-b4b9-34fba35e08f6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "992cb23b-f0e5-4bb7-a3b2-f0f9634fe190"}], "security_groups": [{"name": "tempest-securitygroup--204482932"}], "key_name": "tempest-keypair-1164743971", "user_data": "}} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:57:08.701626 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.network.neutron [None req-54838cdd-a444-4a11-a3c3-79e5e81b9e73 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] validate_networks() for [('992cb23b-f0e5-4bb7-a3b2-f0f9634fe190', None, None, None, None, None)] {{(pid=120440) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 01:57:08.831219 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-8ee51c19-9c89-43ee-ac41-68a735e59dae tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:08.831907 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-8ee51c19-9c89-43ee-ac41-68a735e59dae tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] [instance: d49774a5-7f65-4e40-9a54-a51ccb508212] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:08.838219 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8ee51c19-9c89-43ee-ac41-68a735e59dae tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:08.838774 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8ee51c19-9c89-43ee-ac41-68a735e59dae tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:08.839270 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8ee51c19-9c89-43ee-ac41-68a735e59dae tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:08.840053 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8ee51c19-9c89-43ee-ac41-68a735e59dae tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:08.840575 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8ee51c19-9c89-43ee-ac41-68a735e59dae tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:08.841060 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8ee51c19-9c89-43ee-ac41-68a735e59dae tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:08.846489 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell1:SELECT=100 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:57:08.987999 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-8ee51c19-9c89-43ee-ac41-68a735e59dae tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a194fd36e3024b1f86837cc12ac0c2bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6e7560b314358bd9589ac38b69320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:08.998937 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-8ee51c19-9c89-43ee-ac41-68a735e59dae tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] 10.222.0.42 "GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212" status: 200 len: 1465 microversion: 2.1 time: 0.171731 Sep 16 01:57:09.012169 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 231/447] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:57:08 2022] GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212 => generated 1465 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:57:09.053664 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-21e47fab-c411-49f0-be19-50db18f07bc3 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:09.054650 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-21e47fab-c411-49f0-be19-50db18f07bc3 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] [instance: d49774a5-7f65-4e40-9a54-a51ccb508212] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:09.060924 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-21e47fab-c411-49f0-be19-50db18f07bc3 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:09.062520 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-21e47fab-c411-49f0-be19-50db18f07bc3 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:09.062958 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-21e47fab-c411-49f0-be19-50db18f07bc3 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:09.063667 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-21e47fab-c411-49f0-be19-50db18f07bc3 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:09.064171 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-21e47fab-c411-49f0-be19-50db18f07bc3 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:09.064603 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-21e47fab-c411-49f0-be19-50db18f07bc3 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:09.092288 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-21e47fab-c411-49f0-be19-50db18f07bc3 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] [instance: d49774a5-7f65-4e40-9a54-a51ccb508212] Going to try to terminate instance {{(pid=120441) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 01:57:09.124057 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.virt.hardware [None req-54838cdd-a444-4a11-a3c3-79e5e81b9e73 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Flavor limits 0:0:0 {{(pid=120440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 01:57:09.124822 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.virt.hardware [None req-54838cdd-a444-4a11-a3c3-79e5e81b9e73 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Image limits 0:0:0 {{(pid=120440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 01:57:09.125309 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.virt.hardware [None req-54838cdd-a444-4a11-a3c3-79e5e81b9e73 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Flavor pref 0:0:0 {{(pid=120440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 01:57:09.125905 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.virt.hardware [None req-54838cdd-a444-4a11-a3c3-79e5e81b9e73 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Image pref 0:0:0 {{(pid=120440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 01:57:09.126328 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.virt.hardware [None req-54838cdd-a444-4a11-a3c3-79e5e81b9e73 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 01:57:09.137219 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-54838cdd-a444-4a11-a3c3-79e5e81b9e73 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:09.137701 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-54838cdd-a444-4a11-a3c3-79e5e81b9e73 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:09.138258 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-54838cdd-a444-4a11-a3c3-79e5e81b9e73 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:09.139973 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-54838cdd-a444-4a11-a3c3-79e5e81b9e73 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:09.140812 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-54838cdd-a444-4a11-a3c3-79e5e81b9e73 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:09.141476 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-54838cdd-a444-4a11-a3c3-79e5e81b9e73 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:09.162484 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.quota [None req-54838cdd-a444-4a11-a3c3-79e5e81b9e73 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Getting quotas for project 57aaf234892543698d91303961f14abd. Resources: {'cores', 'ram', 'instances'} {{(pid=120440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 01:57:09.167038 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.quota [None req-54838cdd-a444-4a11-a3c3-79e5e81b9e73 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Getting quotas for user 7eb6ab0644bf4fa59d7bba232d6ccb3c and project 57aaf234892543698d91303961f14abd. Resources: {'cores', 'ram', 'instances'} {{(pid=120440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 01:57:09.181227 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-54838cdd-a444-4a11-a3c3-79e5e81b9e73 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Going to run 1 instances... {{(pid=120440) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 01:57:09.184793 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-54838cdd-a444-4a11-a3c3-79e5e81b9e73 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 40664bec-019b-4246-ad2b-3badd9b2e317] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1546da04-912c-44c6-b4b9-34fba35e08f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 01:57:09.195613 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-21e47fab-c411-49f0-be19-50db18f07bc3 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] 10.222.0.42 "DELETE /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212" status: 204 len: 0 microversion: 2.1 time: 0.145516 Sep 16 01:57:09.199667 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 232/448] 10.222.0.42 () {58 vars in 1239 bytes} [Fri Sep 16 01:57:09 2022] DELETE /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212 => generated 0 bytes in 148 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 16 01:57:09.207345 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-8e99874d-fe64-4f6f-8c30-af4dca0c63bb tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:09.208199 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-8e99874d-fe64-4f6f-8c30-af4dca0c63bb tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] [instance: d49774a5-7f65-4e40-9a54-a51ccb508212] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:09.214483 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8e99874d-fe64-4f6f-8c30-af4dca0c63bb tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:09.214980 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8e99874d-fe64-4f6f-8c30-af4dca0c63bb tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:09.215526 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8e99874d-fe64-4f6f-8c30-af4dca0c63bb tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:09.216329 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8e99874d-fe64-4f6f-8c30-af4dca0c63bb tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:09.216792 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8e99874d-fe64-4f6f-8c30-af4dca0c63bb tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:09.217220 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8e99874d-fe64-4f6f-8c30-af4dca0c63bb tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:09.237361 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-54838cdd-a444-4a11-a3c3-79e5e81b9e73 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.650125 Sep 16 01:57:09.238215 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 217/449] 10.222.0.42 () {60 vars in 1147 bytes} [Fri Sep 16 01:57:08 2022] POST /compute/v2.1/servers => generated 408 bytes in 651 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 01:57:09.250606 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-70d4b313-c906-42f1-955e-65ee81097ee7 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:09.251293 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-70d4b313-c906-42f1-955e-65ee81097ee7 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 40664bec-019b-4246-ad2b-3badd9b2e317] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:09.324579 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-70d4b313-c906-42f1-955e-65ee81097ee7 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:09.333805 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-70d4b313-c906-42f1-955e-65ee81097ee7 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317" status: 200 len: 1246 microversion: 2.1 time: 0.087778 Sep 16 01:57:09.334690 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 218/450] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:57:09 2022] GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317 => generated 1246 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:57:09.359018 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-8e99874d-fe64-4f6f-8c30-af4dca0c63bb tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a194fd36e3024b1f86837cc12ac0c2bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6e7560b314358bd9589ac38b69320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:09.366995 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-8e99874d-fe64-4f6f-8c30-af4dca0c63bb tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] 10.222.0.42 "GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212" status: 200 len: 1471 microversion: 2.1 time: 0.165876 Sep 16 01:57:09.367857 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 233/451] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:57:09 2022] GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212 => generated 1471 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 01:57:10.360548 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-35923020-5665-4424-8a34-b20d35136556 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:10.361151 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-35923020-5665-4424-8a34-b20d35136556 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 40664bec-019b-4246-ad2b-3badd9b2e317] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:10.367460 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-35923020-5665-4424-8a34-b20d35136556 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:10.367966 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-35923020-5665-4424-8a34-b20d35136556 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:10.368435 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-35923020-5665-4424-8a34-b20d35136556 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:10.369117 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-35923020-5665-4424-8a34-b20d35136556 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:10.369565 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-35923020-5665-4424-8a34-b20d35136556 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:10.369984 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-35923020-5665-4424-8a34-b20d35136556 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:10.392611 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-5c5ae22a-ff94-4b65-bf94-dfd8eb831f00 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:10.393402 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-5c5ae22a-ff94-4b65-bf94-dfd8eb831f00 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] [instance: d49774a5-7f65-4e40-9a54-a51ccb508212] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:10.400485 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5c5ae22a-ff94-4b65-bf94-dfd8eb831f00 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:10.401141 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5c5ae22a-ff94-4b65-bf94-dfd8eb831f00 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:10.401790 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5c5ae22a-ff94-4b65-bf94-dfd8eb831f00 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:10.402594 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5c5ae22a-ff94-4b65-bf94-dfd8eb831f00 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:10.403089 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5c5ae22a-ff94-4b65-bf94-dfd8eb831f00 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:10.403537 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5c5ae22a-ff94-4b65-bf94-dfd8eb831f00 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:10.449339 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-35923020-5665-4424-8a34-b20d35136556 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:10.462172 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-35923020-5665-4424-8a34-b20d35136556 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317" status: 200 len: 1250 microversion: 2.1 time: 0.108146 Sep 16 01:57:10.462761 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 219/452] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:57:10 2022] GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317 => generated 1250 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:57:10.555956 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-5c5ae22a-ff94-4b65-bf94-dfd8eb831f00 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a194fd36e3024b1f86837cc12ac0c2bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6e7560b314358bd9589ac38b69320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:10.564818 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-5c5ae22a-ff94-4b65-bf94-dfd8eb831f00 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] 10.222.0.42 "GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212" status: 200 len: 1471 microversion: 2.1 time: 0.176782 Sep 16 01:57:10.565392 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 234/453] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:57:10 2022] GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212 => generated 1471 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 01:57:11.486229 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-1537493f-6cb3-44aa-bfbe-898959587579 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:11.486851 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-1537493f-6cb3-44aa-bfbe-898959587579 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 40664bec-019b-4246-ad2b-3badd9b2e317] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:11.493956 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1537493f-6cb3-44aa-bfbe-898959587579 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:11.494450 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1537493f-6cb3-44aa-bfbe-898959587579 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:11.494883 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1537493f-6cb3-44aa-bfbe-898959587579 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:11.495571 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1537493f-6cb3-44aa-bfbe-898959587579 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:11.496096 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1537493f-6cb3-44aa-bfbe-898959587579 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:11.496477 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1537493f-6cb3-44aa-bfbe-898959587579 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:11.577408 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-1537493f-6cb3-44aa-bfbe-898959587579 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:11.590516 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-1537493f-6cb3-44aa-bfbe-898959587579 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317" status: 200 len: 1306 microversion: 2.1 time: 0.108915 Sep 16 01:57:11.591034 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-e166ff90-343c-4266-a839-5936c5ae5cb7 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:11.592262 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-e166ff90-343c-4266-a839-5936c5ae5cb7 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] [instance: d49774a5-7f65-4e40-9a54-a51ccb508212] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:11.600326 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 220/454] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:57:11 2022] GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317 => generated 1306 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:57:11.600979 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e166ff90-343c-4266-a839-5936c5ae5cb7 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:11.601659 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e166ff90-343c-4266-a839-5936c5ae5cb7 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:11.602103 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e166ff90-343c-4266-a839-5936c5ae5cb7 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:11.602799 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e166ff90-343c-4266-a839-5936c5ae5cb7 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:11.603285 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e166ff90-343c-4266-a839-5936c5ae5cb7 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:11.603715 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e166ff90-343c-4266-a839-5936c5ae5cb7 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:11.860802 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-e166ff90-343c-4266-a839-5936c5ae5cb7 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a194fd36e3024b1f86837cc12ac0c2bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6e7560b314358bd9589ac38b69320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:11.869329 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-e166ff90-343c-4266-a839-5936c5ae5cb7 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] 10.222.0.42 "GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212" status: 200 len: 1471 microversion: 2.1 time: 0.284608 Sep 16 01:57:11.883999 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 235/455] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:57:11 2022] GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212 => generated 1471 bytes in 287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 01:57:12.118591 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [req-e534abf6-4f64-4ecb-9aea-1f42e6cdba59 req-ba0cfc89-d249-45bb-9a1a-ef282f840438 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d49774a5-7f65-4e40-9a54-a51ccb508212", "name": "network-vif-deleted", "tag": "4d61ca38-566b-46a3-baab-8d7accb7917f"}]} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:57:12.129832 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-e534abf6-4f64-4ecb-9aea-1f42e6cdba59 req-ba0cfc89-d249-45bb-9a1a-ef282f840438 service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:12.130324 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-e534abf6-4f64-4ecb-9aea-1f42e6cdba59 req-ba0cfc89-d249-45bb-9a1a-ef282f840438 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:12.130747 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-e534abf6-4f64-4ecb-9aea-1f42e6cdba59 req-ba0cfc89-d249-45bb-9a1a-ef282f840438 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:12.144474 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.compute.server_external_events [req-e534abf6-4f64-4ecb-9aea-1f42e6cdba59 req-ba0cfc89-d249-45bb-9a1a-ef282f840438 service nova] Creating event network-vif-deleted:4d61ca38-566b-46a3-baab-8d7accb7917f for instance d49774a5-7f65-4e40-9a54-a51ccb508212 on hv-cinder-84914 Sep 16 01:57:12.150133 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [req-e534abf6-4f64-4ecb-9aea-1f42e6cdba59 req-ba0cfc89-d249-45bb-9a1a-ef282f840438 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035848 Sep 16 01:57:12.152145 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 221/456] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 01:57:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:57:12.613981 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-2f6a0ab4-cda7-41a0-86df-d190e782aa26 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:12.614701 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-2f6a0ab4-cda7-41a0-86df-d190e782aa26 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 40664bec-019b-4246-ad2b-3badd9b2e317] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:12.620804 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2f6a0ab4-cda7-41a0-86df-d190e782aa26 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:12.621392 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2f6a0ab4-cda7-41a0-86df-d190e782aa26 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:12.621907 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2f6a0ab4-cda7-41a0-86df-d190e782aa26 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:12.622703 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2f6a0ab4-cda7-41a0-86df-d190e782aa26 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:12.623263 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2f6a0ab4-cda7-41a0-86df-d190e782aa26 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:12.624590 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2f6a0ab4-cda7-41a0-86df-d190e782aa26 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:12.760161 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-2f6a0ab4-cda7-41a0-86df-d190e782aa26 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:12.768805 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-2f6a0ab4-cda7-41a0-86df-d190e782aa26 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317" status: 200 len: 1371 microversion: 2.1 time: 0.158740 Sep 16 01:57:12.769358 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 236/457] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:57:12 2022] GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317 => generated 1371 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:57:12.896145 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-f840af4e-cb6b-4eeb-9d43-1b0bf24d144c tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:12.897015 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-f840af4e-cb6b-4eeb-9d43-1b0bf24d144c tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] [instance: d49774a5-7f65-4e40-9a54-a51ccb508212] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:12.903929 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f840af4e-cb6b-4eeb-9d43-1b0bf24d144c tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:12.904583 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f840af4e-cb6b-4eeb-9d43-1b0bf24d144c tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:12.905784 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f840af4e-cb6b-4eeb-9d43-1b0bf24d144c tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:12.906489 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f840af4e-cb6b-4eeb-9d43-1b0bf24d144c tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:12.906949 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f840af4e-cb6b-4eeb-9d43-1b0bf24d144c tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:12.907375 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f840af4e-cb6b-4eeb-9d43-1b0bf24d144c tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:12.941249 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f840af4e-cb6b-4eeb-9d43-1b0bf24d144c tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:12.941660 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f840af4e-cb6b-4eeb-9d43-1b0bf24d144c tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:12.942098 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f840af4e-cb6b-4eeb-9d43-1b0bf24d144c tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:12.942551 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.objects.instance [None req-f840af4e-cb6b-4eeb-9d43-1b0bf24d144c tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lazy-loading 'fault' on Instance uuid d49774a5-7f65-4e40-9a54-a51ccb508212 {{(pid=120440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 01:57:12.986218 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-f840af4e-cb6b-4eeb-9d43-1b0bf24d144c tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a194fd36e3024b1f86837cc12ac0c2bb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'fbe6e7560b314358bd9589ac38b69320', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:12.993489 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-f840af4e-cb6b-4eeb-9d43-1b0bf24d144c tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] 10.222.0.42 "GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212" status: 200 len: 1305 microversion: 2.1 time: 0.101892 Sep 16 01:57:12.994388 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 222/458] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:57:12 2022] GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212 => generated 1305 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:57:13.792820 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-ecb86e24-5516-492a-a19e-832844c423b1 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:13.793427 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-ecb86e24-5516-492a-a19e-832844c423b1 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 40664bec-019b-4246-ad2b-3badd9b2e317] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:13.800304 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ecb86e24-5516-492a-a19e-832844c423b1 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:13.801001 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ecb86e24-5516-492a-a19e-832844c423b1 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:13.801601 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ecb86e24-5516-492a-a19e-832844c423b1 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:13.802292 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ecb86e24-5516-492a-a19e-832844c423b1 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:13.802739 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ecb86e24-5516-492a-a19e-832844c423b1 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:13.803153 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ecb86e24-5516-492a-a19e-832844c423b1 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:14.005276 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-ecb86e24-5516-492a-a19e-832844c423b1 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:14.013035 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-ecb86e24-5516-492a-a19e-832844c423b1 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317" status: 200 len: 1371 microversion: 2.1 time: 0.224255 Sep 16 01:57:14.013795 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 237/459] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:57:13 2022] GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317 => generated 1371 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:57:14.018407 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-e7b81e6c-520d-45e7-ad43-5f8559553624 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:14.019013 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-e7b81e6c-520d-45e7-ad43-5f8559553624 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] [instance: d49774a5-7f65-4e40-9a54-a51ccb508212] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:14.025329 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e7b81e6c-520d-45e7-ad43-5f8559553624 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:14.025995 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e7b81e6c-520d-45e7-ad43-5f8559553624 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:14.026434 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e7b81e6c-520d-45e7-ad43-5f8559553624 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:14.027092 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e7b81e6c-520d-45e7-ad43-5f8559553624 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:14.027535 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e7b81e6c-520d-45e7-ad43-5f8559553624 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:14.027972 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e7b81e6c-520d-45e7-ad43-5f8559553624 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:14.041291 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.wsgi [None req-e7b81e6c-520d-45e7-ad43-5f8559553624 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] HTTP exception thrown: Instance d49774a5-7f65-4e40-9a54-a51ccb508212 could not be found. Sep 16 01:57:14.042904 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-e7b81e6c-520d-45e7-ad43-5f8559553624 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Request method failure captured: Sep 16 01:57:14.042904 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: request: GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212 HTTP/1.1 Sep 16 01:57:14.042904 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept: application/json Sep 16 01:57:14.042904 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept-Encoding: identity Sep 16 01:57:14.042904 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Connection: close Sep 16 01:57:14.042904 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Length: 0 Sep 16 01:57:14.042904 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Type: application/json Sep 16 01:57:14.042904 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Host: 10.222.0.42 Sep 16 01:57:14.042904 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Openstack-System-Scope: None Sep 16 01:57:14.042904 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: User-Agent: python-urllib3/1.26.12 Sep 16 01:57:14.042904 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Auth-Token: gAAAAABjI9fQjsCZVczmXWhWftNShqwIgwiRTYdP7UswBcFK4RZjZkcrUSRlhgCetROKFTP-fbieatvw5YU2ldvbNM3Adwyyq58rQRE0QfrCig9dHPS9uJry3B8lRrTsYYDbM8M-6eLbIXIoIQeh3LzFRjPw5_E5n8GYxU_dYfFfwByxyUju5wo Sep 16 01:57:14.042904 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Id: None Sep 16 01:57:14.042904 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Name: None Sep 16 01:57:14.042904 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Identity-Status: Confirmed Sep 16 01:57:14.042904 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Is-Admin-Project: True Sep 16 01:57:14.042904 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Id: default Sep 16 01:57:14.042904 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Name: Default Sep 16 01:57:14.042904 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Id: fbe6e7560b314358bd9589ac38b69320 Sep 16 01:57:14.042904 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Name: tempest-VolumesNegativeTest-70432738 Sep 16 01:57:14.042904 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Role: member,reader Sep 16 01:57:14.042904 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Roles: member,reader Sep 16 01:57:14.044444 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/fbe6e7560b314358bd9589ac38b69320"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fbe6e7560b314358bd9589ac38b69320"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_fbe6e7560b314358bd9589ac38b69320"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/fbe6e7560b314358bd9589ac38b69320"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 01:57:14.044444 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant: tempest-VolumesNegativeTest-70432738 Sep 16 01:57:14.044444 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Id: fbe6e7560b314358bd9589ac38b69320 Sep 16 01:57:14.044444 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Name: tempest-VolumesNegativeTest-70432738 Sep 16 01:57:14.044444 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User: tempest-VolumesNegativeTest-70432738-project Sep 16 01:57:14.044444 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Id: default Sep 16 01:57:14.044444 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Name: Default Sep 16 01:57:14.044444 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Id: a194fd36e3024b1f86837cc12ac0c2bb Sep 16 01:57:14.044444 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Name: tempest-VolumesNegativeTest-70432738-project Sep 16 01:57:14.044444 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: method: > Sep 16 01:57:14.044444 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: exception: Instance d49774a5-7f65-4e40-9a54-a51ccb508212 could not be found. Sep 16 01:57:14.044444 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: action_args: {'id': 'd49774a5-7f65-4e40-9a54-a51ccb508212'} Sep 16 01:57:14.045595 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 01:57:14.045595 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:57:14.045595 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 01:57:14.045595 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 01:57:14.045595 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 01:57:14.045595 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 01:57:14.045595 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 01:57:14.045595 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 01:57:14.045595 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 01:57:14.045595 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 01:57:14.045595 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d49774a5-7f65-4e40-9a54-a51ccb508212 could not be found. Sep 16 01:57:14.045595 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 01:57:14.045595 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:57:14.045595 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 01:57:14.045595 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:57:14.045595 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 01:57:14.045595 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 01:57:14.045595 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 01:57:14.045595 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 01:57:14.045595 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 01:57:14.047077 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 01:57:14.047077 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 01:57:14.047077 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 01:57:14.047077 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 01:57:14.047077 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 01:57:14.047077 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 01:57:14.047077 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 01:57:14.047077 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d49774a5-7f65-4e40-9a54-a51ccb508212 could not be found. Sep 16 01:57:14.047077 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 01:57:14.047077 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:57:14.047077 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 01:57:14.047077 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:57:14.047077 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 01:57:14.047077 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 01:57:14.047077 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 01:57:14.047077 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 01:57:14.047077 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d49774a5-7f65-4e40-9a54-a51ccb508212 could not be found. Sep 16 01:57:14.047077 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 01:57:14.048649 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-e7b81e6c-520d-45e7-ad43-5f8559553624 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] Returning 404 to user: Instance d49774a5-7f65-4e40-9a54-a51ccb508212 could not be found. {{(pid=120440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 01:57:14.048649 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-e7b81e6c-520d-45e7-ad43-5f8559553624 tempest-VolumesNegativeTest-70432738 tempest-VolumesNegativeTest-70432738-project] 10.222.0.42 "GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212" status: 404 len: 111 microversion: 2.1 time: 0.030602 Sep 16 01:57:14.048649 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 223/460] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:57:14 2022] GET /compute/v2.1/servers/d49774a5-7f65-4e40-9a54-a51ccb508212 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 01:57:14.175266 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [req-0d649825-93f9-48a1-b9bf-74fae81ec68b req-fda68d38-c0d0-4329-a05b-cac2b3ec9d60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40664bec-019b-4246-ad2b-3badd9b2e317", "tag": "1f6c616e-c78b-414c-883d-8d50a28be1bc"}]} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:57:14.184538 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-0d649825-93f9-48a1-b9bf-74fae81ec68b req-fda68d38-c0d0-4329-a05b-cac2b3ec9d60 service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:14.185010 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-0d649825-93f9-48a1-b9bf-74fae81ec68b req-fda68d38-c0d0-4329-a05b-cac2b3ec9d60 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:14.185493 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-0d649825-93f9-48a1-b9bf-74fae81ec68b req-fda68d38-c0d0-4329-a05b-cac2b3ec9d60 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:14.197597 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.compute.server_external_events [req-0d649825-93f9-48a1-b9bf-74fae81ec68b req-fda68d38-c0d0-4329-a05b-cac2b3ec9d60 service nova] Creating event network-changed:1f6c616e-c78b-414c-883d-8d50a28be1bc for instance 40664bec-019b-4246-ad2b-3badd9b2e317 on hv-cinder-84914 Sep 16 01:57:14.203421 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [req-0d649825-93f9-48a1-b9bf-74fae81ec68b req-fda68d38-c0d0-4329-a05b-cac2b3ec9d60 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031831 Sep 16 01:57:14.204039 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 238/461] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 01:57:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:57:15.036734 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-716c0696-b25f-49cd-a03b-50dace135526 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:15.037362 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-716c0696-b25f-49cd-a03b-50dace135526 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 40664bec-019b-4246-ad2b-3badd9b2e317] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:15.043731 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-716c0696-b25f-49cd-a03b-50dace135526 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:15.044255 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-716c0696-b25f-49cd-a03b-50dace135526 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:15.044704 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-716c0696-b25f-49cd-a03b-50dace135526 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:15.045400 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-716c0696-b25f-49cd-a03b-50dace135526 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:15.045851 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-716c0696-b25f-49cd-a03b-50dace135526 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:15.046271 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-716c0696-b25f-49cd-a03b-50dace135526 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:15.184582 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-716c0696-b25f-49cd-a03b-50dace135526 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:15.193002 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-716c0696-b25f-49cd-a03b-50dace135526 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317" status: 200 len: 1371 microversion: 2.1 time: 0.159993 Sep 16 01:57:15.193886 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 224/462] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:57:15 2022] GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317 => generated 1371 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:57:16.217641 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-00009a06-8220-4e15-843a-606e8b166fc1 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:16.218340 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-00009a06-8220-4e15-843a-606e8b166fc1 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 40664bec-019b-4246-ad2b-3badd9b2e317] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:16.224355 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-00009a06-8220-4e15-843a-606e8b166fc1 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:16.224839 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-00009a06-8220-4e15-843a-606e8b166fc1 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:16.225268 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-00009a06-8220-4e15-843a-606e8b166fc1 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:16.225945 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-00009a06-8220-4e15-843a-606e8b166fc1 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:16.226392 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-00009a06-8220-4e15-843a-606e8b166fc1 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:16.226808 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-00009a06-8220-4e15-843a-606e8b166fc1 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:16.362284 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-00009a06-8220-4e15-843a-606e8b166fc1 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:16.370228 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-00009a06-8220-4e15-843a-606e8b166fc1 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317" status: 200 len: 1371 microversion: 2.1 time: 0.156877 Sep 16 01:57:16.370790 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 239/463] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:57:16 2022] GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317 => generated 1371 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:57:17.394695 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-515417e2-3362-4139-8e26-37dad09800c4 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:17.395335 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-515417e2-3362-4139-8e26-37dad09800c4 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 40664bec-019b-4246-ad2b-3badd9b2e317] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:17.401826 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-515417e2-3362-4139-8e26-37dad09800c4 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:17.402312 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-515417e2-3362-4139-8e26-37dad09800c4 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:17.402750 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-515417e2-3362-4139-8e26-37dad09800c4 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:17.403435 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-515417e2-3362-4139-8e26-37dad09800c4 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:17.403885 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-515417e2-3362-4139-8e26-37dad09800c4 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:17.404345 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-515417e2-3362-4139-8e26-37dad09800c4 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:17.535909 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-515417e2-3362-4139-8e26-37dad09800c4 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:17.543537 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-515417e2-3362-4139-8e26-37dad09800c4 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317" status: 200 len: 1371 microversion: 2.1 time: 0.152781 Sep 16 01:57:17.544120 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 225/464] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:57:17 2022] GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317 => generated 1371 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:57:18.162226 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [req-1e70a29a-7ad5-44d5-9553-8b166ba8ec99 req-db2d8702-cd86-47cc-bd96-9ba4df9b0c2d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40664bec-019b-4246-ad2b-3badd9b2e317", "name": "network-vif-plugged", "status": "completed", "tag": "1f6c616e-c78b-414c-883d-8d50a28be1bc"}]} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:57:18.173321 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-1e70a29a-7ad5-44d5-9553-8b166ba8ec99 req-db2d8702-cd86-47cc-bd96-9ba4df9b0c2d service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:18.174079 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-1e70a29a-7ad5-44d5-9553-8b166ba8ec99 req-db2d8702-cd86-47cc-bd96-9ba4df9b0c2d service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:18.174663 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-1e70a29a-7ad5-44d5-9553-8b166ba8ec99 req-db2d8702-cd86-47cc-bd96-9ba4df9b0c2d service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:18.187108 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.compute.server_external_events [req-1e70a29a-7ad5-44d5-9553-8b166ba8ec99 req-db2d8702-cd86-47cc-bd96-9ba4df9b0c2d service nova] Creating event network-vif-plugged:1f6c616e-c78b-414c-883d-8d50a28be1bc for instance 40664bec-019b-4246-ad2b-3badd9b2e317 on hv-cinder-84914 Sep 16 01:57:18.192285 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [req-1e70a29a-7ad5-44d5-9553-8b166ba8ec99 req-db2d8702-cd86-47cc-bd96-9ba4df9b0c2d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035518 Sep 16 01:57:18.192938 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 240/465] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 01:57:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:57:18.567101 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-eaaf9455-836d-416b-8759-76c7f82908a7 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:18.567659 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-eaaf9455-836d-416b-8759-76c7f82908a7 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 40664bec-019b-4246-ad2b-3badd9b2e317] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:18.574559 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-eaaf9455-836d-416b-8759-76c7f82908a7 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:18.575060 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-eaaf9455-836d-416b-8759-76c7f82908a7 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:18.575497 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-eaaf9455-836d-416b-8759-76c7f82908a7 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:18.576368 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-eaaf9455-836d-416b-8759-76c7f82908a7 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:18.577062 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-eaaf9455-836d-416b-8759-76c7f82908a7 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:18.577461 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-eaaf9455-836d-416b-8759-76c7f82908a7 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:18.721202 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-eaaf9455-836d-416b-8759-76c7f82908a7 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:18.729017 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-eaaf9455-836d-416b-8759-76c7f82908a7 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317" status: 200 len: 1371 microversion: 2.1 time: 0.165874 Sep 16 01:57:18.729584 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 226/466] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:57:18 2022] GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317 => generated 1371 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:57:19.754848 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-0395b18a-9911-4b23-b13f-2027d608e41d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:19.755538 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-0395b18a-9911-4b23-b13f-2027d608e41d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 40664bec-019b-4246-ad2b-3badd9b2e317] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:19.757442 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_api:SELECT=57,nova_api:UPDATE=1 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:57:19.762813 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0395b18a-9911-4b23-b13f-2027d608e41d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:19.763288 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0395b18a-9911-4b23-b13f-2027d608e41d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:19.763754 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0395b18a-9911-4b23-b13f-2027d608e41d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:19.764750 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0395b18a-9911-4b23-b13f-2027d608e41d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:19.765203 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0395b18a-9911-4b23-b13f-2027d608e41d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:19.765623 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0395b18a-9911-4b23-b13f-2027d608e41d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:19.894394 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-0395b18a-9911-4b23-b13f-2027d608e41d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:19.902016 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-0395b18a-9911-4b23-b13f-2027d608e41d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317" status: 200 len: 1371 microversion: 2.1 time: 0.151720 Sep 16 01:57:19.902511 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 241/467] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:57:19 2022] GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317 => generated 1371 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:57:20.933715 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-85fd9608-9086-4b2c-ae0b-d5d6cc144ce7 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:20.934356 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-85fd9608-9086-4b2c-ae0b-d5d6cc144ce7 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 40664bec-019b-4246-ad2b-3badd9b2e317] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:20.936825 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell0:SELECT=2 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:57:20.937507 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell0:SELECT=12 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:57:20.943597 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-85fd9608-9086-4b2c-ae0b-d5d6cc144ce7 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:20.944131 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-85fd9608-9086-4b2c-ae0b-d5d6cc144ce7 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:20.944569 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-85fd9608-9086-4b2c-ae0b-d5d6cc144ce7 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:20.945246 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-85fd9608-9086-4b2c-ae0b-d5d6cc144ce7 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:20.945693 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-85fd9608-9086-4b2c-ae0b-d5d6cc144ce7 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:20.946114 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-85fd9608-9086-4b2c-ae0b-d5d6cc144ce7 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:21.082679 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-85fd9608-9086-4b2c-ae0b-d5d6cc144ce7 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:21.090888 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-85fd9608-9086-4b2c-ae0b-d5d6cc144ce7 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317" status: 200 len: 1564 microversion: 2.1 time: 0.161005 Sep 16 01:57:21.091610 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 227/468] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:57:20 2022] GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317 => generated 1564 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:57:21.114255 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-0773b8af-5858-4911-adac-a732648e9c8e tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:21.114770 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-0773b8af-5858-4911-adac-a732648e9c8e tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 40664bec-019b-4246-ad2b-3badd9b2e317] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:21.120535 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0773b8af-5858-4911-adac-a732648e9c8e tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:21.121010 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0773b8af-5858-4911-adac-a732648e9c8e tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:21.121438 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0773b8af-5858-4911-adac-a732648e9c8e tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:21.122108 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0773b8af-5858-4911-adac-a732648e9c8e tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:21.122554 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0773b8af-5858-4911-adac-a732648e9c8e tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:21.122968 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0773b8af-5858-4911-adac-a732648e9c8e tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:21.203225 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-0773b8af-5858-4911-adac-a732648e9c8e tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.092842 Sep 16 01:57:21.203839 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 242/469] 10.222.0.42 () {58 vars in 1275 bytes} [Fri Sep 16 01:57:21 2022] GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317/os-interface => generated 284 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:57:22.362825 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [req-ad42b9e9-ae54-42a7-872d-540c620bf4dc req-a68c6fc8-4279-466b-8bb8-154edb1a9dab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40664bec-019b-4246-ad2b-3badd9b2e317", "tag": "1f6c616e-c78b-414c-883d-8d50a28be1bc"}]} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:57:22.372082 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-ad42b9e9-ae54-42a7-872d-540c620bf4dc req-a68c6fc8-4279-466b-8bb8-154edb1a9dab service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:22.372554 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-ad42b9e9-ae54-42a7-872d-540c620bf4dc req-a68c6fc8-4279-466b-8bb8-154edb1a9dab service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:22.373539 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-ad42b9e9-ae54-42a7-872d-540c620bf4dc req-a68c6fc8-4279-466b-8bb8-154edb1a9dab service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:22.384757 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.compute.server_external_events [req-ad42b9e9-ae54-42a7-872d-540c620bf4dc req-a68c6fc8-4279-466b-8bb8-154edb1a9dab service nova] Creating event network-changed:1f6c616e-c78b-414c-883d-8d50a28be1bc for instance 40664bec-019b-4246-ad2b-3badd9b2e317 on hv-cinder-84914 Sep 16 01:57:22.391307 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [req-ad42b9e9-ae54-42a7-872d-540c620bf4dc req-a68c6fc8-4279-466b-8bb8-154edb1a9dab service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032234 Sep 16 01:57:22.391903 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 228/470] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 01:57:22 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:57:25.174795 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 01:57:25.175340 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Fri Sep 16 01:57:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6/ips (ip 10.222.0.42) !!! Sep 16 01:57:25.179490 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-1826d549-a39a-4e3f-98bb-1b33ba644259 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:25.180001 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-1826d549-a39a-4e3f-98bb-1b33ba644259 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:25.186980 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1826d549-a39a-4e3f-98bb-1b33ba644259 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:25.187456 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1826d549-a39a-4e3f-98bb-1b33ba644259 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:25.187913 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1826d549-a39a-4e3f-98bb-1b33ba644259 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:25.188613 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1826d549-a39a-4e3f-98bb-1b33ba644259 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:25.189056 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1826d549-a39a-4e3f-98bb-1b33ba644259 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:25.189472 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1826d549-a39a-4e3f-98bb-1b33ba644259 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:25.213877 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-1826d549-a39a-4e3f-98bb-1b33ba644259 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6/ips" status: 200 len: 151 microversion: 2.20 time: 0.040182 Sep 16 01:57:25.214424 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 243/471] 10.222.0.42 () {60 vars in 1289 bytes} [Fri Sep 16 01:57:25 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6/ips => generated 151 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 01:57:26.535657 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-df6c2c66-3362-4ac9-9ba5-af65bd4cdcbf tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:26.536290 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-df6c2c66-3362-4ac9-9ba5-af65bd4cdcbf tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:26.543004 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-df6c2c66-3362-4ac9-9ba5-af65bd4cdcbf tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:26.543495 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-df6c2c66-3362-4ac9-9ba5-af65bd4cdcbf tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:26.544154 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-df6c2c66-3362-4ac9-9ba5-af65bd4cdcbf tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:26.544655 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-df6c2c66-3362-4ac9-9ba5-af65bd4cdcbf tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:26.545284 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-df6c2c66-3362-4ac9-9ba5-af65bd4cdcbf tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:26.545716 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-df6c2c66-3362-4ac9-9ba5-af65bd4cdcbf tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:26.574336 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-df6c2c66-3362-4ac9-9ba5-af65bd4cdcbf tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763/ips" status: 200 len: 145 microversion: 2.1 time: 0.042857 Sep 16 01:57:26.574969 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 229/472] 10.222.0.42 () {58 vars in 1248 bytes} [Fri Sep 16 01:57:26 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763/ips => generated 145 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 01:57:27.271174 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-c9f8bc7b-8340-480c-80c0-c847cd46e6e9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:57:27.271750 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-c9f8bc7b-8340-480c-80c0-c847cd46e6e9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:27.277716 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c9f8bc7b-8340-480c-80c0-c847cd46e6e9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:27.278221 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c9f8bc7b-8340-480c-80c0-c847cd46e6e9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:27.278656 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c9f8bc7b-8340-480c-80c0-c847cd46e6e9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:27.280053 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c9f8bc7b-8340-480c-80c0-c847cd46e6e9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:27.280503 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c9f8bc7b-8340-480c-80c0-c847cd46e6e9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:27.280929 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c9f8bc7b-8340-480c-80c0-c847cd46e6e9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:27.302686 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.objects.instance [None req-c9f8bc7b-8340-480c-80c0-c847cd46e6e9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lazy-loading 'flavor' on Instance uuid 3e390b45-0b39-4429-9431-7ee6af3806e6 {{(pid=120441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 01:57:27.491108 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-c9f8bc7b-8340-480c-80c0-c847cd46e6e9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "POST /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6/action" status: 202 len: 0 microversion: 2.20 time: 0.223449 Sep 16 01:57:27.491904 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 244/473] 10.222.0.42 () {62 vars in 1319 bytes} [Fri Sep 16 01:57:27 2022] POST /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6/action => generated 0 bytes in 225 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 16 01:57:27.501188 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-5f57a5a9-fccc-48d5-82f4-b6268ddef6ab tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:27.501921 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-5f57a5a9-fccc-48d5-82f4-b6268ddef6ab tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:27.508176 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-5f57a5a9-fccc-48d5-82f4-b6268ddef6ab tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:27.508799 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-5f57a5a9-fccc-48d5-82f4-b6268ddef6ab tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:27.509232 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-5f57a5a9-fccc-48d5-82f4-b6268ddef6ab tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:27.509922 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-5f57a5a9-fccc-48d5-82f4-b6268ddef6ab tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:27.510363 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-5f57a5a9-fccc-48d5-82f4-b6268ddef6ab tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:27.510817 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-5f57a5a9-fccc-48d5-82f4-b6268ddef6ab tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:27.639828 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-5f57a5a9-fccc-48d5-82f4-b6268ddef6ab tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:27.647765 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-5f57a5a9-fccc-48d5-82f4-b6268ddef6ab tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:27.649222 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-5f57a5a9-fccc-48d5-82f4-b6268ddef6ab tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:27.650419 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-5f57a5a9-fccc-48d5-82f4-b6268ddef6ab tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1724 microversion: 2.20 time: 0.153882 Sep 16 01:57:27.650959 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 230/474] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:57:27 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:57:28.676704 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-c93ac586-20f3-4a5a-890b-53c7bf689c27 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:28.677319 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-c93ac586-20f3-4a5a-890b-53c7bf689c27 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:28.683390 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c93ac586-20f3-4a5a-890b-53c7bf689c27 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:28.683863 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c93ac586-20f3-4a5a-890b-53c7bf689c27 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:28.684320 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c93ac586-20f3-4a5a-890b-53c7bf689c27 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:28.685003 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c93ac586-20f3-4a5a-890b-53c7bf689c27 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:28.686202 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c93ac586-20f3-4a5a-890b-53c7bf689c27 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:28.686764 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c93ac586-20f3-4a5a-890b-53c7bf689c27 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:28.821585 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-c93ac586-20f3-4a5a-890b-53c7bf689c27 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:28.829651 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-c93ac586-20f3-4a5a-890b-53c7bf689c27 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:28.831093 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-c93ac586-20f3-4a5a-890b-53c7bf689c27 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:28.832278 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-c93ac586-20f3-4a5a-890b-53c7bf689c27 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1724 microversion: 2.20 time: 0.160093 Sep 16 01:57:28.832833 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 245/475] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:57:28 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:57:29.511577 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-2970e18e-5285-4f52-9127-2e42ff9ae882 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "e6ab01ee-9b00-4e36-96c0-b677ce0a4c5b"}} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:57:29.514640 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-2970e18e-5285-4f52-9127-2e42ff9ae882 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:29.517029 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_api:SELECT=70,nova_api:INSERT=4 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:57:29.522496 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2970e18e-5285-4f52-9127-2e42ff9ae882 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:29.522926 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2970e18e-5285-4f52-9127-2e42ff9ae882 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:29.523363 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2970e18e-5285-4f52-9127-2e42ff9ae882 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:29.524085 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2970e18e-5285-4f52-9127-2e42ff9ae882 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:29.524562 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2970e18e-5285-4f52-9127-2e42ff9ae882 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:29.524984 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2970e18e-5285-4f52-9127-2e42ff9ae882 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:29.596511 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell1:SELECT=100 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:57:29.814840 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-2970e18e-5285-4f52-9127-2e42ff9ae882 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "POST /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.307124 Sep 16 01:57:29.815450 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 231/476] 10.222.0.42 () {60 vars in 1323 bytes} [Fri Sep 16 01:57:29 2022] POST /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763/os-volume_attachments => generated 194 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:57:29.856793 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-93e38d47-8364-41f9-9ded-fa92866517b2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:29.858184 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-93e38d47-8364-41f9-9ded-fa92866517b2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:29.864108 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-93e38d47-8364-41f9-9ded-fa92866517b2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:29.864590 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-93e38d47-8364-41f9-9ded-fa92866517b2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:29.865018 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-93e38d47-8364-41f9-9ded-fa92866517b2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:29.865698 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-93e38d47-8364-41f9-9ded-fa92866517b2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:29.866144 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-93e38d47-8364-41f9-9ded-fa92866517b2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:29.866557 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-93e38d47-8364-41f9-9ded-fa92866517b2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:29.870837 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:57:29.998090 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-93e38d47-8364-41f9-9ded-fa92866517b2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:30.006412 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-93e38d47-8364-41f9-9ded-fa92866517b2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:30.007833 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-93e38d47-8364-41f9-9ded-fa92866517b2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:30.009007 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-93e38d47-8364-41f9-9ded-fa92866517b2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1724 microversion: 2.20 time: 0.156141 Sep 16 01:57:30.009625 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 246/477] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:57:29 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:57:31.035243 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-69810e95-e9c3-4967-b677-92a9a75ae1ed tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:31.035954 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-69810e95-e9c3-4967-b677-92a9a75ae1ed tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:31.042157 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-69810e95-e9c3-4967-b677-92a9a75ae1ed tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:31.042685 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-69810e95-e9c3-4967-b677-92a9a75ae1ed tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:31.043224 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-69810e95-e9c3-4967-b677-92a9a75ae1ed tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:31.044010 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-69810e95-e9c3-4967-b677-92a9a75ae1ed tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:31.045174 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-69810e95-e9c3-4967-b677-92a9a75ae1ed tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:31.045776 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-69810e95-e9c3-4967-b677-92a9a75ae1ed tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:31.173368 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-69810e95-e9c3-4967-b677-92a9a75ae1ed tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:31.181381 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-69810e95-e9c3-4967-b677-92a9a75ae1ed tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:31.182835 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-69810e95-e9c3-4967-b677-92a9a75ae1ed tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:31.184013 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-69810e95-e9c3-4967-b677-92a9a75ae1ed tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1724 microversion: 2.20 time: 0.153561 Sep 16 01:57:31.184574 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 232/478] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:57:31 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:57:32.210159 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-48008aac-5454-422c-8e5b-fc26d114b6d4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:32.210707 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-48008aac-5454-422c-8e5b-fc26d114b6d4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:32.217041 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-48008aac-5454-422c-8e5b-fc26d114b6d4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:32.217513 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-48008aac-5454-422c-8e5b-fc26d114b6d4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:32.217935 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-48008aac-5454-422c-8e5b-fc26d114b6d4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:32.218608 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-48008aac-5454-422c-8e5b-fc26d114b6d4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:32.219051 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-48008aac-5454-422c-8e5b-fc26d114b6d4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:32.219468 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-48008aac-5454-422c-8e5b-fc26d114b6d4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:32.345525 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-48008aac-5454-422c-8e5b-fc26d114b6d4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:32.353534 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-48008aac-5454-422c-8e5b-fc26d114b6d4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:32.354970 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-48008aac-5454-422c-8e5b-fc26d114b6d4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:32.356148 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-48008aac-5454-422c-8e5b-fc26d114b6d4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1724 microversion: 2.20 time: 0.149885 Sep 16 01:57:32.356698 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 247/479] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:57:32 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:57:33.381559 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-dfe6a52c-c83d-4a87-bc3f-58e30dcc46bb tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:33.382170 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-dfe6a52c-c83d-4a87-bc3f-58e30dcc46bb tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:33.389227 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-dfe6a52c-c83d-4a87-bc3f-58e30dcc46bb tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:33.389901 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-dfe6a52c-c83d-4a87-bc3f-58e30dcc46bb tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:33.390340 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-dfe6a52c-c83d-4a87-bc3f-58e30dcc46bb tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:33.391027 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-dfe6a52c-c83d-4a87-bc3f-58e30dcc46bb tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:33.391480 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-dfe6a52c-c83d-4a87-bc3f-58e30dcc46bb tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:33.391904 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-dfe6a52c-c83d-4a87-bc3f-58e30dcc46bb tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:33.522619 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-dfe6a52c-c83d-4a87-bc3f-58e30dcc46bb tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:33.531724 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-dfe6a52c-c83d-4a87-bc3f-58e30dcc46bb tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:33.533180 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-dfe6a52c-c83d-4a87-bc3f-58e30dcc46bb tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:33.534799 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-dfe6a52c-c83d-4a87-bc3f-58e30dcc46bb tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1724 microversion: 2.20 time: 0.157118 Sep 16 01:57:33.535847 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 233/480] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:57:33 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:57:34.562273 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-9412a744-60ff-4a2a-9f8f-3fe2fc4275ce tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:34.562843 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-9412a744-60ff-4a2a-9f8f-3fe2fc4275ce tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:34.568992 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9412a744-60ff-4a2a-9f8f-3fe2fc4275ce tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:34.569472 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9412a744-60ff-4a2a-9f8f-3fe2fc4275ce tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:34.569902 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9412a744-60ff-4a2a-9f8f-3fe2fc4275ce tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:34.570580 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9412a744-60ff-4a2a-9f8f-3fe2fc4275ce tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:34.571027 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9412a744-60ff-4a2a-9f8f-3fe2fc4275ce tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:34.571447 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9412a744-60ff-4a2a-9f8f-3fe2fc4275ce tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:34.701749 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-9412a744-60ff-4a2a-9f8f-3fe2fc4275ce tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:34.709665 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-9412a744-60ff-4a2a-9f8f-3fe2fc4275ce tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:34.711102 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-9412a744-60ff-4a2a-9f8f-3fe2fc4275ce tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:34.712281 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-9412a744-60ff-4a2a-9f8f-3fe2fc4275ce tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1724 microversion: 2.20 time: 0.154835 Sep 16 01:57:34.712840 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 248/481] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:57:34 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:57:35.739102 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-0f599036-6014-4664-bde3-c031e4fcdeaf tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:35.739706 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-0f599036-6014-4664-bde3-c031e4fcdeaf tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:35.746512 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0f599036-6014-4664-bde3-c031e4fcdeaf tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:35.746995 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0f599036-6014-4664-bde3-c031e4fcdeaf tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:35.747535 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0f599036-6014-4664-bde3-c031e4fcdeaf tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:35.748408 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0f599036-6014-4664-bde3-c031e4fcdeaf tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:35.748851 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0f599036-6014-4664-bde3-c031e4fcdeaf tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:35.749274 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0f599036-6014-4664-bde3-c031e4fcdeaf tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:35.882500 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-0f599036-6014-4664-bde3-c031e4fcdeaf tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:35.890689 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-0f599036-6014-4664-bde3-c031e4fcdeaf tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:35.892275 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-0f599036-6014-4664-bde3-c031e4fcdeaf tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:35.893428 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-0f599036-6014-4664-bde3-c031e4fcdeaf tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1724 microversion: 2.20 time: 0.158311 Sep 16 01:57:35.893978 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 234/482] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:57:35 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:57:36.918604 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-33653e25-d04a-4015-ad25-13a5d5c8bc9f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:36.919257 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-33653e25-d04a-4015-ad25-13a5d5c8bc9f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:36.925262 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-33653e25-d04a-4015-ad25-13a5d5c8bc9f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:36.925751 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-33653e25-d04a-4015-ad25-13a5d5c8bc9f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:36.926181 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-33653e25-d04a-4015-ad25-13a5d5c8bc9f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:36.926870 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-33653e25-d04a-4015-ad25-13a5d5c8bc9f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:36.927318 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-33653e25-d04a-4015-ad25-13a5d5c8bc9f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:36.927742 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-33653e25-d04a-4015-ad25-13a5d5c8bc9f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:37.060727 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-33653e25-d04a-4015-ad25-13a5d5c8bc9f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:37.069896 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-33653e25-d04a-4015-ad25-13a5d5c8bc9f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:37.071254 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-33653e25-d04a-4015-ad25-13a5d5c8bc9f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:37.072533 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-33653e25-d04a-4015-ad25-13a5d5c8bc9f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1724 microversion: 2.20 time: 0.157769 Sep 16 01:57:37.073087 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 249/483] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:57:36 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:57:37.343635 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-3d2a334c-cd5e-4a59-b65b-83a4cf18fb02 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:57:37.350028 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3d2a334c-cd5e-4a59-b65b-83a4cf18fb02 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:37.350516 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3d2a334c-cd5e-4a59-b65b-83a4cf18fb02 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:37.350955 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3d2a334c-cd5e-4a59-b65b-83a4cf18fb02 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:37.410104 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-3d2a334c-cd5e-4a59-b65b-83a4cf18fb02 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Going to try to stop instance {{(pid=120440) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 16 01:57:37.455354 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-3d2a334c-cd5e-4a59-b65b-83a4cf18fb02 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "POST /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763/action" status: 202 len: 0 microversion: 2.1 time: 0.115274 Sep 16 01:57:37.456783 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 235/484] 10.222.0.42 () {60 vars in 1278 bytes} [Fri Sep 16 01:57:37 2022] POST /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763/action => generated 0 bytes in 118 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 01:57:37.469242 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-c282793d-4117-46b1-8806-92927cd90d77 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:37.470382 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-c282793d-4117-46b1-8806-92927cd90d77 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:37.481056 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c282793d-4117-46b1-8806-92927cd90d77 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:37.481918 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c282793d-4117-46b1-8806-92927cd90d77 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:37.482414 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c282793d-4117-46b1-8806-92927cd90d77 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:37.483688 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c282793d-4117-46b1-8806-92927cd90d77 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:37.484261 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c282793d-4117-46b1-8806-92927cd90d77 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:37.484758 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c282793d-4117-46b1-8806-92927cd90d77 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:37.618816 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-c282793d-4117-46b1-8806-92927cd90d77 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:37.627637 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-c282793d-4117-46b1-8806-92927cd90d77 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1724 microversion: 2.1 time: 0.165734 Sep 16 01:57:37.628222 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 250/485] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:57:37 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1724 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:57:38.100040 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-18b76e9d-0518-4c42-a436-efabac877295 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:38.100666 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-18b76e9d-0518-4c42-a436-efabac877295 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:38.106783 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-18b76e9d-0518-4c42-a436-efabac877295 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:38.107316 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-18b76e9d-0518-4c42-a436-efabac877295 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:38.107749 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-18b76e9d-0518-4c42-a436-efabac877295 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:38.108457 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-18b76e9d-0518-4c42-a436-efabac877295 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:38.108908 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-18b76e9d-0518-4c42-a436-efabac877295 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:38.109331 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-18b76e9d-0518-4c42-a436-efabac877295 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:38.238026 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-18b76e9d-0518-4c42-a436-efabac877295 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:38.246909 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-18b76e9d-0518-4c42-a436-efabac877295 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:38.248947 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-18b76e9d-0518-4c42-a436-efabac877295 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:38.250103 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-18b76e9d-0518-4c42-a436-efabac877295 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1724 microversion: 2.20 time: 0.154389 Sep 16 01:57:38.250658 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 236/486] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:57:38 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:57:38.651388 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-1b4a61fa-cdc1-42f2-978a-a582b9d9fd2b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:38.652027 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-1b4a61fa-cdc1-42f2-978a-a582b9d9fd2b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:38.658526 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1b4a61fa-cdc1-42f2-978a-a582b9d9fd2b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:38.659001 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1b4a61fa-cdc1-42f2-978a-a582b9d9fd2b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:38.659433 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1b4a61fa-cdc1-42f2-978a-a582b9d9fd2b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:38.660135 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1b4a61fa-cdc1-42f2-978a-a582b9d9fd2b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:38.660582 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1b4a61fa-cdc1-42f2-978a-a582b9d9fd2b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:38.661006 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1b4a61fa-cdc1-42f2-978a-a582b9d9fd2b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:38.787988 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-1b4a61fa-cdc1-42f2-978a-a582b9d9fd2b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:38.796690 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-1b4a61fa-cdc1-42f2-978a-a582b9d9fd2b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1724 microversion: 2.1 time: 0.149171 Sep 16 01:57:38.797255 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 251/487] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:57:38 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:57:39.276515 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-6d117d2e-2206-4d01-95c3-e7553e3000fd tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:39.277115 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-6d117d2e-2206-4d01-95c3-e7553e3000fd tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:39.283892 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6d117d2e-2206-4d01-95c3-e7553e3000fd tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:39.284403 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6d117d2e-2206-4d01-95c3-e7553e3000fd tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:39.284844 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6d117d2e-2206-4d01-95c3-e7553e3000fd tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:39.285532 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6d117d2e-2206-4d01-95c3-e7553e3000fd tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:39.285989 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6d117d2e-2206-4d01-95c3-e7553e3000fd tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:39.286421 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6d117d2e-2206-4d01-95c3-e7553e3000fd tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:39.416942 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-6d117d2e-2206-4d01-95c3-e7553e3000fd tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:39.424936 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-6d117d2e-2206-4d01-95c3-e7553e3000fd tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:39.426385 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-6d117d2e-2206-4d01-95c3-e7553e3000fd tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:39.427536 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-6d117d2e-2206-4d01-95c3-e7553e3000fd tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1724 microversion: 2.20 time: 0.154958 Sep 16 01:57:39.428126 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 237/488] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:57:39 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:57:39.820237 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-2d5d9d6f-6c6b-4512-85ec-88ccd30bb647 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:39.820839 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-2d5d9d6f-6c6b-4512-85ec-88ccd30bb647 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:39.826888 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2d5d9d6f-6c6b-4512-85ec-88ccd30bb647 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:39.827395 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2d5d9d6f-6c6b-4512-85ec-88ccd30bb647 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:39.827822 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2d5d9d6f-6c6b-4512-85ec-88ccd30bb647 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:39.828518 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2d5d9d6f-6c6b-4512-85ec-88ccd30bb647 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:39.828964 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2d5d9d6f-6c6b-4512-85ec-88ccd30bb647 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:39.829378 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2d5d9d6f-6c6b-4512-85ec-88ccd30bb647 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:39.955629 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-2d5d9d6f-6c6b-4512-85ec-88ccd30bb647 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:39.963607 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-2d5d9d6f-6c6b-4512-85ec-88ccd30bb647 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1724 microversion: 2.1 time: 0.147205 Sep 16 01:57:39.964194 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 252/489] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:57:39 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1724 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:57:40.454064 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-d07a526b-7fcb-47ce-9ea8-3d975d63246b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:40.454670 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-d07a526b-7fcb-47ce-9ea8-3d975d63246b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:40.461165 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d07a526b-7fcb-47ce-9ea8-3d975d63246b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:40.461673 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d07a526b-7fcb-47ce-9ea8-3d975d63246b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:40.462107 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d07a526b-7fcb-47ce-9ea8-3d975d63246b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:40.462793 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d07a526b-7fcb-47ce-9ea8-3d975d63246b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:40.463243 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d07a526b-7fcb-47ce-9ea8-3d975d63246b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:40.463664 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d07a526b-7fcb-47ce-9ea8-3d975d63246b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:40.596174 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-d07a526b-7fcb-47ce-9ea8-3d975d63246b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:40.604674 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-d07a526b-7fcb-47ce-9ea8-3d975d63246b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:40.606133 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-d07a526b-7fcb-47ce-9ea8-3d975d63246b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:40.608165 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-d07a526b-7fcb-47ce-9ea8-3d975d63246b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1745 microversion: 2.20 time: 0.158693 Sep 16 01:57:40.608715 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 238/490] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:57:40 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 01:57:40.987299 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-d3f028a2-e8f1-4562-abd3-23f5c485613a tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:40.987910 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-d3f028a2-e8f1-4562-abd3-23f5c485613a tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:40.993895 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d3f028a2-e8f1-4562-abd3-23f5c485613a tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:40.994408 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d3f028a2-e8f1-4562-abd3-23f5c485613a tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:40.994839 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d3f028a2-e8f1-4562-abd3-23f5c485613a tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:40.995551 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d3f028a2-e8f1-4562-abd3-23f5c485613a tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:40.996045 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d3f028a2-e8f1-4562-abd3-23f5c485613a tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:40.996473 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d3f028a2-e8f1-4562-abd3-23f5c485613a tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:41.130745 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-d3f028a2-e8f1-4562-abd3-23f5c485613a tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:41.138896 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-d3f028a2-e8f1-4562-abd3-23f5c485613a tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1724 microversion: 2.1 time: 0.155491 Sep 16 01:57:41.139459 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 253/491] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:57:40 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 01:57:41.634771 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-9e2d616a-478d-43b0-9649-9dc17c589d28 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:41.635362 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-9e2d616a-478d-43b0-9649-9dc17c589d28 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:41.642727 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9e2d616a-478d-43b0-9649-9dc17c589d28 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:41.643215 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9e2d616a-478d-43b0-9649-9dc17c589d28 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:41.643651 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9e2d616a-478d-43b0-9649-9dc17c589d28 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:41.644365 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9e2d616a-478d-43b0-9649-9dc17c589d28 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:41.644812 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9e2d616a-478d-43b0-9649-9dc17c589d28 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:41.645235 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9e2d616a-478d-43b0-9649-9dc17c589d28 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:41.777259 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-9e2d616a-478d-43b0-9649-9dc17c589d28 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:41.785314 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-9e2d616a-478d-43b0-9649-9dc17c589d28 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:41.786757 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-9e2d616a-478d-43b0-9649-9dc17c589d28 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:41.787905 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-9e2d616a-478d-43b0-9649-9dc17c589d28 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1745 microversion: 2.20 time: 0.157058 Sep 16 01:57:41.788480 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 239/492] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:57:41 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1745 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:57:42.162699 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-bf7a9566-db35-403c-9255-cacec3248113 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:42.163312 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-bf7a9566-db35-403c-9255-cacec3248113 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:42.170378 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-bf7a9566-db35-403c-9255-cacec3248113 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:42.170845 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-bf7a9566-db35-403c-9255-cacec3248113 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:42.171274 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-bf7a9566-db35-403c-9255-cacec3248113 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:42.171994 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-bf7a9566-db35-403c-9255-cacec3248113 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:42.172496 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-bf7a9566-db35-403c-9255-cacec3248113 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:42.172913 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-bf7a9566-db35-403c-9255-cacec3248113 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:42.306943 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-bf7a9566-db35-403c-9255-cacec3248113 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:42.316283 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-bf7a9566-db35-403c-9255-cacec3248113 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1724 microversion: 2.1 time: 0.157499 Sep 16 01:57:42.316849 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 254/493] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:57:42 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:57:42.357482 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [req-1ac9b84b-d0ec-4ee3-a929-40a3fde55ea2 req-11372a3e-7056-4fb9-94c9-ab0c86b89d9b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e390b45-0b39-4429-9431-7ee6af3806e6", "name": "network-vif-plugged", "status": "completed", "tag": "dc91b77b-583a-4740-a244-adc53daa4347"}]} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:57:42.367375 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-1ac9b84b-d0ec-4ee3-a929-40a3fde55ea2 req-11372a3e-7056-4fb9-94c9-ab0c86b89d9b service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:42.367994 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-1ac9b84b-d0ec-4ee3-a929-40a3fde55ea2 req-11372a3e-7056-4fb9-94c9-ab0c86b89d9b service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:42.368434 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-1ac9b84b-d0ec-4ee3-a929-40a3fde55ea2 req-11372a3e-7056-4fb9-94c9-ab0c86b89d9b service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:42.380242 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.compute.server_external_events [req-1ac9b84b-d0ec-4ee3-a929-40a3fde55ea2 req-11372a3e-7056-4fb9-94c9-ab0c86b89d9b service nova] Creating event network-vif-plugged:dc91b77b-583a-4740-a244-adc53daa4347 for instance 3e390b45-0b39-4429-9431-7ee6af3806e6 on hv-cinder-84914 Sep 16 01:57:42.385252 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [req-1ac9b84b-d0ec-4ee3-a929-40a3fde55ea2 req-11372a3e-7056-4fb9-94c9-ab0c86b89d9b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032120 Sep 16 01:57:42.386013 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 240/494] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 01:57:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:57:42.812463 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-facca9dd-1fe4-4cf7-89c3-23f37d47e8de tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:42.813066 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-facca9dd-1fe4-4cf7-89c3-23f37d47e8de tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:42.818896 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-facca9dd-1fe4-4cf7-89c3-23f37d47e8de tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:42.819376 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-facca9dd-1fe4-4cf7-89c3-23f37d47e8de tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:42.819801 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-facca9dd-1fe4-4cf7-89c3-23f37d47e8de tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:42.820500 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-facca9dd-1fe4-4cf7-89c3-23f37d47e8de tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:42.820944 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-facca9dd-1fe4-4cf7-89c3-23f37d47e8de tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:42.821361 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-facca9dd-1fe4-4cf7-89c3-23f37d47e8de tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:42.950083 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-facca9dd-1fe4-4cf7-89c3-23f37d47e8de tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:42.958761 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-facca9dd-1fe4-4cf7-89c3-23f37d47e8de tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:42.960205 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-facca9dd-1fe4-4cf7-89c3-23f37d47e8de tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:42.961336 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-facca9dd-1fe4-4cf7-89c3-23f37d47e8de tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1745 microversion: 2.20 time: 0.152813 Sep 16 01:57:42.961881 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 255/495] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:57:42 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1745 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:57:43.340843 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-d83ad017-f8b1-4c0b-ae7b-0e3a607a7edb tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:43.341832 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-d83ad017-f8b1-4c0b-ae7b-0e3a607a7edb tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:43.347871 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d83ad017-f8b1-4c0b-ae7b-0e3a607a7edb tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:43.348381 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d83ad017-f8b1-4c0b-ae7b-0e3a607a7edb tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:43.348808 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d83ad017-f8b1-4c0b-ae7b-0e3a607a7edb tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:43.349479 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d83ad017-f8b1-4c0b-ae7b-0e3a607a7edb tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:43.349925 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d83ad017-f8b1-4c0b-ae7b-0e3a607a7edb tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:43.350339 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d83ad017-f8b1-4c0b-ae7b-0e3a607a7edb tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:43.476789 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-d83ad017-f8b1-4c0b-ae7b-0e3a607a7edb tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:43.484834 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-d83ad017-f8b1-4c0b-ae7b-0e3a607a7edb tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1724 microversion: 2.1 time: 0.148603 Sep 16 01:57:43.485384 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 241/496] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:57:43 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1724 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:57:43.987609 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-361d2b6d-8a30-49d3-8e0b-cba790fb0ede tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:43.988198 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-361d2b6d-8a30-49d3-8e0b-cba790fb0ede tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:43.994540 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-361d2b6d-8a30-49d3-8e0b-cba790fb0ede tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:43.995024 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-361d2b6d-8a30-49d3-8e0b-cba790fb0ede tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:43.995453 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-361d2b6d-8a30-49d3-8e0b-cba790fb0ede tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:43.996303 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-361d2b6d-8a30-49d3-8e0b-cba790fb0ede tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:43.996689 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-361d2b6d-8a30-49d3-8e0b-cba790fb0ede tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:43.997142 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-361d2b6d-8a30-49d3-8e0b-cba790fb0ede tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:44.154409 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-361d2b6d-8a30-49d3-8e0b-cba790fb0ede tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:44.164262 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-361d2b6d-8a30-49d3-8e0b-cba790fb0ede tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:44.165712 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-361d2b6d-8a30-49d3-8e0b-cba790fb0ede tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:44.166894 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-361d2b6d-8a30-49d3-8e0b-cba790fb0ede tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1745 microversion: 2.20 time: 0.183306 Sep 16 01:57:44.167452 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 256/497] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:57:43 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1745 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:57:44.508930 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-986e5fc7-a675-49a9-bf43-256017a13e3c tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:44.509774 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-986e5fc7-a675-49a9-bf43-256017a13e3c tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:44.516451 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-986e5fc7-a675-49a9-bf43-256017a13e3c tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:44.516932 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-986e5fc7-a675-49a9-bf43-256017a13e3c tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:44.517361 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-986e5fc7-a675-49a9-bf43-256017a13e3c tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:44.518049 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-986e5fc7-a675-49a9-bf43-256017a13e3c tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:44.518496 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-986e5fc7-a675-49a9-bf43-256017a13e3c tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:44.518911 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-986e5fc7-a675-49a9-bf43-256017a13e3c tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:44.657398 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-986e5fc7-a675-49a9-bf43-256017a13e3c tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:44.665471 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-986e5fc7-a675-49a9-bf43-256017a13e3c tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1724 microversion: 2.1 time: 0.160454 Sep 16 01:57:44.666039 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 242/498] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:57:44 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:57:45.193655 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-e2b6da94-2d07-430d-afad-1535269781ec tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:45.194375 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-e2b6da94-2d07-430d-afad-1535269781ec tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:45.200773 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e2b6da94-2d07-430d-afad-1535269781ec tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:45.201332 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e2b6da94-2d07-430d-afad-1535269781ec tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:45.201838 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e2b6da94-2d07-430d-afad-1535269781ec tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:45.202605 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e2b6da94-2d07-430d-afad-1535269781ec tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:45.203127 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e2b6da94-2d07-430d-afad-1535269781ec tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:45.203746 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e2b6da94-2d07-430d-afad-1535269781ec tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:45.340865 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-e2b6da94-2d07-430d-afad-1535269781ec tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:45.349810 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-e2b6da94-2d07-430d-afad-1535269781ec tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:45.351252 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-e2b6da94-2d07-430d-afad-1535269781ec tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:45.352457 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-e2b6da94-2d07-430d-afad-1535269781ec tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1740 microversion: 2.20 time: 0.162703 Sep 16 01:57:45.353004 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 257/499] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:57:45 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1740 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 01:57:45.688144 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-cc77ad17-807e-4296-a5b7-68fb459d84e9 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:45.688827 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-cc77ad17-807e-4296-a5b7-68fb459d84e9 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:45.696099 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cc77ad17-807e-4296-a5b7-68fb459d84e9 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:45.696785 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cc77ad17-807e-4296-a5b7-68fb459d84e9 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:45.697953 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cc77ad17-807e-4296-a5b7-68fb459d84e9 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:45.699053 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cc77ad17-807e-4296-a5b7-68fb459d84e9 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:45.699517 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cc77ad17-807e-4296-a5b7-68fb459d84e9 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:45.699970 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cc77ad17-807e-4296-a5b7-68fb459d84e9 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:45.839393 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-cc77ad17-807e-4296-a5b7-68fb459d84e9 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:45.848719 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-cc77ad17-807e-4296-a5b7-68fb459d84e9 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1724 microversion: 2.1 time: 0.164528 Sep 16 01:57:45.849287 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 243/500] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:57:45 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1724 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:57:46.383010 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-ef8894b8-9c07-464b-8f43-4ac5f762e799 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:46.383614 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-ef8894b8-9c07-464b-8f43-4ac5f762e799 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:46.391523 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ef8894b8-9c07-464b-8f43-4ac5f762e799 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:46.392032 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ef8894b8-9c07-464b-8f43-4ac5f762e799 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:46.392659 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ef8894b8-9c07-464b-8f43-4ac5f762e799 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:46.393618 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ef8894b8-9c07-464b-8f43-4ac5f762e799 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:46.394135 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ef8894b8-9c07-464b-8f43-4ac5f762e799 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:46.394780 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ef8894b8-9c07-464b-8f43-4ac5f762e799 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:46.532589 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-ef8894b8-9c07-464b-8f43-4ac5f762e799 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:46.541292 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-ef8894b8-9c07-464b-8f43-4ac5f762e799 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:46.543311 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-ef8894b8-9c07-464b-8f43-4ac5f762e799 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:46.545122 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-ef8894b8-9c07-464b-8f43-4ac5f762e799 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1740 microversion: 2.20 time: 0.165764 Sep 16 01:57:46.560604 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 258/501] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:57:46 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1740 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:57:46.873240 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-199d8fb1-17d8-4bdd-b5ba-f9bd4c673af9 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:46.874510 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-199d8fb1-17d8-4bdd-b5ba-f9bd4c673af9 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:46.883772 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-199d8fb1-17d8-4bdd-b5ba-f9bd4c673af9 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:46.884163 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-199d8fb1-17d8-4bdd-b5ba-f9bd4c673af9 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:46.884795 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-199d8fb1-17d8-4bdd-b5ba-f9bd4c673af9 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:46.885491 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-199d8fb1-17d8-4bdd-b5ba-f9bd4c673af9 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:46.885946 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-199d8fb1-17d8-4bdd-b5ba-f9bd4c673af9 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:46.886361 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-199d8fb1-17d8-4bdd-b5ba-f9bd4c673af9 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:47.032269 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-199d8fb1-17d8-4bdd-b5ba-f9bd4c673af9 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:47.041726 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-199d8fb1-17d8-4bdd-b5ba-f9bd4c673af9 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1724 microversion: 2.1 time: 0.173288 Sep 16 01:57:47.042656 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 244/502] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:57:46 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:57:47.571414 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-607811cc-3e03-4059-95c3-cdf3e472f9a9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:47.572002 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-607811cc-3e03-4059-95c3-cdf3e472f9a9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:47.578527 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-607811cc-3e03-4059-95c3-cdf3e472f9a9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:47.579024 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-607811cc-3e03-4059-95c3-cdf3e472f9a9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:47.579469 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-607811cc-3e03-4059-95c3-cdf3e472f9a9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:47.580392 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-607811cc-3e03-4059-95c3-cdf3e472f9a9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:47.580672 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-607811cc-3e03-4059-95c3-cdf3e472f9a9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:47.581098 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-607811cc-3e03-4059-95c3-cdf3e472f9a9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:47.733485 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-607811cc-3e03-4059-95c3-cdf3e472f9a9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:47.742312 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-607811cc-3e03-4059-95c3-cdf3e472f9a9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:47.743751 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-607811cc-3e03-4059-95c3-cdf3e472f9a9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:47.744976 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-607811cc-3e03-4059-95c3-cdf3e472f9a9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1740 microversion: 2.20 time: 0.177605 Sep 16 01:57:47.752304 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 259/503] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:57:47 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1740 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:57:48.066877 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-bd1da159-3c85-4038-9678-49ab8d700067 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:48.067632 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-bd1da159-3c85-4038-9678-49ab8d700067 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:48.074715 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bd1da159-3c85-4038-9678-49ab8d700067 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:48.075552 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bd1da159-3c85-4038-9678-49ab8d700067 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:48.076049 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bd1da159-3c85-4038-9678-49ab8d700067 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:48.076997 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bd1da159-3c85-4038-9678-49ab8d700067 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:48.077778 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bd1da159-3c85-4038-9678-49ab8d700067 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:48.078218 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bd1da159-3c85-4038-9678-49ab8d700067 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:48.222500 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-bd1da159-3c85-4038-9678-49ab8d700067 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:48.236175 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-bd1da159-3c85-4038-9678-49ab8d700067 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1724 microversion: 2.1 time: 0.173011 Sep 16 01:57:48.237063 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 245/504] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:57:48 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1724 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:57:48.770678 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-764f305e-f1e6-4db5-a880-f0649748ffb2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:48.771528 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-764f305e-f1e6-4db5-a880-f0649748ffb2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:48.778948 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-764f305e-f1e6-4db5-a880-f0649748ffb2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:48.779537 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-764f305e-f1e6-4db5-a880-f0649748ffb2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:48.780249 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-764f305e-f1e6-4db5-a880-f0649748ffb2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:48.781039 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-764f305e-f1e6-4db5-a880-f0649748ffb2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:48.781701 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-764f305e-f1e6-4db5-a880-f0649748ffb2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:48.782195 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-764f305e-f1e6-4db5-a880-f0649748ffb2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:48.936030 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-764f305e-f1e6-4db5-a880-f0649748ffb2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:48.944826 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-764f305e-f1e6-4db5-a880-f0649748ffb2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:48.946437 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-764f305e-f1e6-4db5-a880-f0649748ffb2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:48.947836 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-764f305e-f1e6-4db5-a880-f0649748ffb2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1740 microversion: 2.20 time: 0.181131 Sep 16 01:57:48.948703 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 260/505] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:57:48 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1740 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 01:57:49.266426 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-59bfb2e2-60e8-4706-9d2a-34353c5dffd8 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:49.268531 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-59bfb2e2-60e8-4706-9d2a-34353c5dffd8 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:49.280394 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-59bfb2e2-60e8-4706-9d2a-34353c5dffd8 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:49.281168 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-59bfb2e2-60e8-4706-9d2a-34353c5dffd8 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:49.281902 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-59bfb2e2-60e8-4706-9d2a-34353c5dffd8 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:49.282756 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-59bfb2e2-60e8-4706-9d2a-34353c5dffd8 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:49.283358 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-59bfb2e2-60e8-4706-9d2a-34353c5dffd8 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:49.283780 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-59bfb2e2-60e8-4706-9d2a-34353c5dffd8 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:49.428786 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-59bfb2e2-60e8-4706-9d2a-34353c5dffd8 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:49.433147 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:57:49.439898 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-59bfb2e2-60e8-4706-9d2a-34353c5dffd8 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1724 microversion: 2.1 time: 0.178779 Sep 16 01:57:49.440848 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 246/506] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:57:49 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1724 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:57:49.975617 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-cb138f7f-65eb-4866-971c-f61d80ca21b3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:49.976407 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-cb138f7f-65eb-4866-971c-f61d80ca21b3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:49.979516 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_api:SELECT=40 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:57:49.985014 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-cb138f7f-65eb-4866-971c-f61d80ca21b3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:49.985777 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-cb138f7f-65eb-4866-971c-f61d80ca21b3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:49.986447 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-cb138f7f-65eb-4866-971c-f61d80ca21b3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:49.987145 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-cb138f7f-65eb-4866-971c-f61d80ca21b3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:49.987601 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-cb138f7f-65eb-4866-971c-f61d80ca21b3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:49.988052 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-cb138f7f-65eb-4866-971c-f61d80ca21b3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:50.126481 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-cb138f7f-65eb-4866-971c-f61d80ca21b3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:50.135509 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-cb138f7f-65eb-4866-971c-f61d80ca21b3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:50.136980 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-cb138f7f-65eb-4866-971c-f61d80ca21b3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:50.138404 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-cb138f7f-65eb-4866-971c-f61d80ca21b3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1740 microversion: 2.20 time: 0.167345 Sep 16 01:57:50.139110 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 261/507] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:57:49 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1740 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:57:50.464378 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-bbdb63db-a57f-4d8d-aabb-46b48a2c98fb tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:50.466204 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-bbdb63db-a57f-4d8d-aabb-46b48a2c98fb tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:50.474131 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bbdb63db-a57f-4d8d-aabb-46b48a2c98fb tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:50.475064 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bbdb63db-a57f-4d8d-aabb-46b48a2c98fb tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:50.475673 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bbdb63db-a57f-4d8d-aabb-46b48a2c98fb tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:50.476405 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bbdb63db-a57f-4d8d-aabb-46b48a2c98fb tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:50.476855 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bbdb63db-a57f-4d8d-aabb-46b48a2c98fb tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:50.477287 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bbdb63db-a57f-4d8d-aabb-46b48a2c98fb tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:50.622796 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-bbdb63db-a57f-4d8d-aabb-46b48a2c98fb tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:50.638589 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-bbdb63db-a57f-4d8d-aabb-46b48a2c98fb tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1724 microversion: 2.1 time: 0.177030 Sep 16 01:57:50.639646 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 247/508] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:57:50 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1724 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:57:51.164790 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-de061f2c-d2a1-4538-aed5-ec78da63dd57 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:51.166016 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-de061f2c-d2a1-4538-aed5-ec78da63dd57 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:51.172629 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-de061f2c-d2a1-4538-aed5-ec78da63dd57 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:51.173112 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-de061f2c-d2a1-4538-aed5-ec78da63dd57 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:51.173577 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-de061f2c-d2a1-4538-aed5-ec78da63dd57 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:51.174332 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-de061f2c-d2a1-4538-aed5-ec78da63dd57 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:51.174788 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-de061f2c-d2a1-4538-aed5-ec78da63dd57 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:51.175206 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-de061f2c-d2a1-4538-aed5-ec78da63dd57 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:51.325883 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-de061f2c-d2a1-4538-aed5-ec78da63dd57 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:51.329665 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell1:SELECT=100 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:57:51.340260 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-de061f2c-d2a1-4538-aed5-ec78da63dd57 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:51.342897 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-de061f2c-d2a1-4538-aed5-ec78da63dd57 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:51.344105 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-de061f2c-d2a1-4538-aed5-ec78da63dd57 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1740 microversion: 2.20 time: 0.183126 Sep 16 01:57:51.344974 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 262/509] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:57:51 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1740 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:57:51.662923 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-571c805c-132d-4fa6-a2e2-5f6a3d94256b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:51.664246 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-571c805c-132d-4fa6-a2e2-5f6a3d94256b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:51.672503 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-571c805c-132d-4fa6-a2e2-5f6a3d94256b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:51.673001 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-571c805c-132d-4fa6-a2e2-5f6a3d94256b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:51.673443 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-571c805c-132d-4fa6-a2e2-5f6a3d94256b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:51.674142 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-571c805c-132d-4fa6-a2e2-5f6a3d94256b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:51.674776 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-571c805c-132d-4fa6-a2e2-5f6a3d94256b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:51.675202 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-571c805c-132d-4fa6-a2e2-5f6a3d94256b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:51.828486 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-571c805c-132d-4fa6-a2e2-5f6a3d94256b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:51.839001 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-571c805c-132d-4fa6-a2e2-5f6a3d94256b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1724 microversion: 2.1 time: 0.180032 Sep 16 01:57:51.839882 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 248/510] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:57:51 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1724 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:57:52.374362 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-b924105b-14d0-46fa-80df-ab459a13cb6d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:52.375108 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-b924105b-14d0-46fa-80df-ab459a13cb6d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:52.382561 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b924105b-14d0-46fa-80df-ab459a13cb6d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:52.383057 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b924105b-14d0-46fa-80df-ab459a13cb6d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:52.383483 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b924105b-14d0-46fa-80df-ab459a13cb6d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:52.384215 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b924105b-14d0-46fa-80df-ab459a13cb6d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:52.384670 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b924105b-14d0-46fa-80df-ab459a13cb6d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:52.385127 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b924105b-14d0-46fa-80df-ab459a13cb6d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:52.527033 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-b924105b-14d0-46fa-80df-ab459a13cb6d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:52.536667 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-b924105b-14d0-46fa-80df-ab459a13cb6d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:52.539732 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-b924105b-14d0-46fa-80df-ab459a13cb6d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:52.539732 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-b924105b-14d0-46fa-80df-ab459a13cb6d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1740 microversion: 2.20 time: 0.169583 Sep 16 01:57:52.540107 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 263/511] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:57:52 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1740 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 01:57:52.868876 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-c59cf6a7-5482-42c9-97d8-a433e1587d08 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:52.870281 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-c59cf6a7-5482-42c9-97d8-a433e1587d08 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:52.881480 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c59cf6a7-5482-42c9-97d8-a433e1587d08 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:52.882000 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c59cf6a7-5482-42c9-97d8-a433e1587d08 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:52.883263 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c59cf6a7-5482-42c9-97d8-a433e1587d08 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:52.884174 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c59cf6a7-5482-42c9-97d8-a433e1587d08 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:52.885044 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c59cf6a7-5482-42c9-97d8-a433e1587d08 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:52.885459 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c59cf6a7-5482-42c9-97d8-a433e1587d08 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:53.040657 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-c59cf6a7-5482-42c9-97d8-a433e1587d08 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:53.051102 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-c59cf6a7-5482-42c9-97d8-a433e1587d08 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1724 microversion: 2.1 time: 0.186067 Sep 16 01:57:53.067679 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 249/512] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:57:52 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1724 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:57:53.566168 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-e4cba3cf-4d4d-42f3-8372-a4d7c9bfedf3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:53.566857 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-e4cba3cf-4d4d-42f3-8372-a4d7c9bfedf3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:53.573016 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e4cba3cf-4d4d-42f3-8372-a4d7c9bfedf3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:53.573530 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e4cba3cf-4d4d-42f3-8372-a4d7c9bfedf3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:53.573949 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e4cba3cf-4d4d-42f3-8372-a4d7c9bfedf3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:53.575391 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e4cba3cf-4d4d-42f3-8372-a4d7c9bfedf3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:53.576156 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e4cba3cf-4d4d-42f3-8372-a4d7c9bfedf3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:53.576720 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e4cba3cf-4d4d-42f3-8372-a4d7c9bfedf3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:53.723308 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-e4cba3cf-4d4d-42f3-8372-a4d7c9bfedf3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:53.732346 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-e4cba3cf-4d4d-42f3-8372-a4d7c9bfedf3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:53.733817 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-e4cba3cf-4d4d-42f3-8372-a4d7c9bfedf3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:53.735042 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-e4cba3cf-4d4d-42f3-8372-a4d7c9bfedf3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1740 microversion: 2.20 time: 0.172734 Sep 16 01:57:53.735622 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 264/513] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:57:53 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1740 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:57:54.074860 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-ee73117d-7163-4909-9302-a67f7c1c8b84 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:54.075829 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-ee73117d-7163-4909-9302-a67f7c1c8b84 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:54.082335 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ee73117d-7163-4909-9302-a67f7c1c8b84 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:54.082822 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ee73117d-7163-4909-9302-a67f7c1c8b84 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:54.083254 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ee73117d-7163-4909-9302-a67f7c1c8b84 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:54.083975 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ee73117d-7163-4909-9302-a67f7c1c8b84 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:54.084452 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ee73117d-7163-4909-9302-a67f7c1c8b84 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:54.085013 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ee73117d-7163-4909-9302-a67f7c1c8b84 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:54.224189 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-ee73117d-7163-4909-9302-a67f7c1c8b84 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:54.233523 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-ee73117d-7163-4909-9302-a67f7c1c8b84 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1701 microversion: 2.1 time: 0.162662 Sep 16 01:57:54.234096 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 250/514] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:57:54 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1701 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:57:54.257013 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-ef887cef-4f5b-4507-800b-ced1b0f58187 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:57:54.264645 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ef887cef-4f5b-4507-800b-ced1b0f58187 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:54.265213 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ef887cef-4f5b-4507-800b-ced1b0f58187 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:54.265720 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ef887cef-4f5b-4507-800b-ced1b0f58187 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:54.328043 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-ef887cef-4f5b-4507-800b-ced1b0f58187 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Going to try to start instance {{(pid=120441) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 16 01:57:54.373714 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-ef887cef-4f5b-4507-800b-ced1b0f58187 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "POST /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763/action" status: 202 len: 0 microversion: 2.1 time: 0.120266 Sep 16 01:57:54.374395 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 265/515] 10.222.0.42 () {60 vars in 1278 bytes} [Fri Sep 16 01:57:54 2022] POST /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763/action => generated 0 bytes in 122 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 01:57:54.382764 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-bfa389bb-c620-4b18-a835-a3064fcb5f7c tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:54.384261 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-bfa389bb-c620-4b18-a835-a3064fcb5f7c tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:54.392652 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bfa389bb-c620-4b18-a835-a3064fcb5f7c tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:54.393675 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bfa389bb-c620-4b18-a835-a3064fcb5f7c tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:54.394728 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bfa389bb-c620-4b18-a835-a3064fcb5f7c tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:54.396096 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bfa389bb-c620-4b18-a835-a3064fcb5f7c tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:54.396638 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bfa389bb-c620-4b18-a835-a3064fcb5f7c tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:54.397152 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bfa389bb-c620-4b18-a835-a3064fcb5f7c tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:54.543363 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-bfa389bb-c620-4b18-a835-a3064fcb5f7c tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:54.552176 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-bfa389bb-c620-4b18-a835-a3064fcb5f7c tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1710 microversion: 2.1 time: 0.173117 Sep 16 01:57:54.552936 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 251/516] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:57:54 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1710 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:57:54.763807 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-d93381db-d0c1-4caa-8b87-4aeb3f73e10f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:54.764449 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-d93381db-d0c1-4caa-8b87-4aeb3f73e10f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:54.770585 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d93381db-d0c1-4caa-8b87-4aeb3f73e10f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:54.771052 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d93381db-d0c1-4caa-8b87-4aeb3f73e10f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:54.771481 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d93381db-d0c1-4caa-8b87-4aeb3f73e10f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:54.772194 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d93381db-d0c1-4caa-8b87-4aeb3f73e10f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:54.772646 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d93381db-d0c1-4caa-8b87-4aeb3f73e10f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:54.773064 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d93381db-d0c1-4caa-8b87-4aeb3f73e10f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:54.977704 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-d93381db-d0c1-4caa-8b87-4aeb3f73e10f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:54.986040 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-d93381db-d0c1-4caa-8b87-4aeb3f73e10f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:54.987499 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-d93381db-d0c1-4caa-8b87-4aeb3f73e10f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:54.988692 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-d93381db-d0c1-4caa-8b87-4aeb3f73e10f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1740 microversion: 2.20 time: 0.229819 Sep 16 01:57:54.989241 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 266/517] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:57:54 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1740 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 01:57:55.575518 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-79856635-d128-4c86-8304-a373a95e2358 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:55.576162 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-79856635-d128-4c86-8304-a373a95e2358 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:55.582506 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-79856635-d128-4c86-8304-a373a95e2358 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:55.582988 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-79856635-d128-4c86-8304-a373a95e2358 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:55.583428 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-79856635-d128-4c86-8304-a373a95e2358 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:55.584150 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-79856635-d128-4c86-8304-a373a95e2358 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:55.584607 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-79856635-d128-4c86-8304-a373a95e2358 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:55.585034 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-79856635-d128-4c86-8304-a373a95e2358 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:55.714484 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-79856635-d128-4c86-8304-a373a95e2358 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:55.722792 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-79856635-d128-4c86-8304-a373a95e2358 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1710 microversion: 2.1 time: 0.151333 Sep 16 01:57:55.723348 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 252/518] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:57:55 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1710 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:57:56.015336 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-82c0c602-7c64-4609-af74-ce1f700a1b80 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:56.016065 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-82c0c602-7c64-4609-af74-ce1f700a1b80 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:56.021925 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-82c0c602-7c64-4609-af74-ce1f700a1b80 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:56.022587 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-82c0c602-7c64-4609-af74-ce1f700a1b80 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:56.023022 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-82c0c602-7c64-4609-af74-ce1f700a1b80 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:56.023705 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-82c0c602-7c64-4609-af74-ce1f700a1b80 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:56.024171 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-82c0c602-7c64-4609-af74-ce1f700a1b80 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:56.024592 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-82c0c602-7c64-4609-af74-ce1f700a1b80 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:56.155719 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-82c0c602-7c64-4609-af74-ce1f700a1b80 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:56.165767 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-82c0c602-7c64-4609-af74-ce1f700a1b80 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:56.167250 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-82c0c602-7c64-4609-af74-ce1f700a1b80 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:56.169017 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-82c0c602-7c64-4609-af74-ce1f700a1b80 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1722 microversion: 2.20 time: 0.157491 Sep 16 01:57:56.169559 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 267/519] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:57:56 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1722 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:57:56.747280 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-87be3d24-8a62-4121-853a-2a56b243c152 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:56.747887 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-87be3d24-8a62-4121-853a-2a56b243c152 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:56.754383 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-87be3d24-8a62-4121-853a-2a56b243c152 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:56.754860 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-87be3d24-8a62-4121-853a-2a56b243c152 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:56.755292 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-87be3d24-8a62-4121-853a-2a56b243c152 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:56.756108 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-87be3d24-8a62-4121-853a-2a56b243c152 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:56.756593 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-87be3d24-8a62-4121-853a-2a56b243c152 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:56.757014 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-87be3d24-8a62-4121-853a-2a56b243c152 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:56.894728 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-87be3d24-8a62-4121-853a-2a56b243c152 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:56.903526 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-87be3d24-8a62-4121-853a-2a56b243c152 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1714 microversion: 2.1 time: 0.160223 Sep 16 01:57:56.904202 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 253/520] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:57:56 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1714 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:57:57.194657 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-84216df0-25ad-4a34-889b-3aa2925379f9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:57.195271 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-84216df0-25ad-4a34-889b-3aa2925379f9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:57.201532 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-84216df0-25ad-4a34-889b-3aa2925379f9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:57.202015 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-84216df0-25ad-4a34-889b-3aa2925379f9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:57.202449 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-84216df0-25ad-4a34-889b-3aa2925379f9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:57.203134 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-84216df0-25ad-4a34-889b-3aa2925379f9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:57.203585 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-84216df0-25ad-4a34-889b-3aa2925379f9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:57.204044 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-84216df0-25ad-4a34-889b-3aa2925379f9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:57.334421 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-84216df0-25ad-4a34-889b-3aa2925379f9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:57.342589 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-84216df0-25ad-4a34-889b-3aa2925379f9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:57.344060 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-84216df0-25ad-4a34-889b-3aa2925379f9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:57.345187 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-84216df0-25ad-4a34-889b-3aa2925379f9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1722 microversion: 2.20 time: 0.154446 Sep 16 01:57:57.345732 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 268/521] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:57:57 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:57:58.296548 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [req-c6c5148f-3068-44ec-abe2-3995b41e08d9 req-662450d0-a3c7-48de-b4bb-f952b8b3c279 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e390b45-0b39-4429-9431-7ee6af3806e6", "name": "network-vif-unplugged", "status": "completed", "tag": "dc91b77b-583a-4740-a244-adc53daa4347"}]} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:57:58.307376 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-c6c5148f-3068-44ec-abe2-3995b41e08d9 req-662450d0-a3c7-48de-b4bb-f952b8b3c279 service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:58.307858 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-c6c5148f-3068-44ec-abe2-3995b41e08d9 req-662450d0-a3c7-48de-b4bb-f952b8b3c279 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:58.308326 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-c6c5148f-3068-44ec-abe2-3995b41e08d9 req-662450d0-a3c7-48de-b4bb-f952b8b3c279 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:58.319364 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.compute.server_external_events [req-c6c5148f-3068-44ec-abe2-3995b41e08d9 req-662450d0-a3c7-48de-b4bb-f952b8b3c279 service nova] Creating event network-vif-unplugged:dc91b77b-583a-4740-a244-adc53daa4347 for instance 3e390b45-0b39-4429-9431-7ee6af3806e6 on hv-cinder-84914 Sep 16 01:57:58.324359 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [req-c6c5148f-3068-44ec-abe2-3995b41e08d9 req-662450d0-a3c7-48de-b4bb-f952b8b3c279 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032138 Sep 16 01:57:58.325242 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 254/522] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 01:57:58 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:57:58.370492 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-0ac691c1-e840-4e6a-8475-b132331bae55 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:58.371102 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-0ac691c1-e840-4e6a-8475-b132331bae55 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:58.377769 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0ac691c1-e840-4e6a-8475-b132331bae55 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:58.378507 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0ac691c1-e840-4e6a-8475-b132331bae55 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:58.378939 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0ac691c1-e840-4e6a-8475-b132331bae55 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:58.379614 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0ac691c1-e840-4e6a-8475-b132331bae55 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:58.380096 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0ac691c1-e840-4e6a-8475-b132331bae55 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:58.380518 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0ac691c1-e840-4e6a-8475-b132331bae55 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:58.510053 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-0ac691c1-e840-4e6a-8475-b132331bae55 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:58.518968 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-0ac691c1-e840-4e6a-8475-b132331bae55 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:58.520420 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-0ac691c1-e840-4e6a-8475-b132331bae55 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:58.521560 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-0ac691c1-e840-4e6a-8475-b132331bae55 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1722 microversion: 2.20 time: 0.154931 Sep 16 01:57:58.522108 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 269/523] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:57:58 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1722 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:57:59.547978 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-64de7cdc-c25b-4dfc-b79a-95f691283b01 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:57:59.548702 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-64de7cdc-c25b-4dfc-b79a-95f691283b01 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:59.550596 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_api:SELECT=48 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:57:59.556578 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-64de7cdc-c25b-4dfc-b79a-95f691283b01 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:59.557062 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-64de7cdc-c25b-4dfc-b79a-95f691283b01 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:59.557496 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-64de7cdc-c25b-4dfc-b79a-95f691283b01 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:59.558171 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-64de7cdc-c25b-4dfc-b79a-95f691283b01 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:59.558623 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-64de7cdc-c25b-4dfc-b79a-95f691283b01 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:59.559048 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-64de7cdc-c25b-4dfc-b79a-95f691283b01 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:59.691263 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-64de7cdc-c25b-4dfc-b79a-95f691283b01 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:59.699480 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-64de7cdc-c25b-4dfc-b79a-95f691283b01 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:59.701773 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-64de7cdc-c25b-4dfc-b79a-95f691283b01 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:57:59.702979 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-64de7cdc-c25b-4dfc-b79a-95f691283b01 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1665 microversion: 2.20 time: 0.159983 Sep 16 01:57:59.703533 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 255/524] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:57:59 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1665 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:57:59.728966 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-73f11810-fc96-4daa-8407-f738ae098549 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5718da94-48fe-4cff-a6ba-0f4044bf3c89"}} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:57:59.731382 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-73f11810-fc96-4daa-8407-f738ae098549 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:57:59.737494 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-73f11810-fc96-4daa-8407-f738ae098549 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:59.737969 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-73f11810-fc96-4daa-8407-f738ae098549 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:59.738397 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-73f11810-fc96-4daa-8407-f738ae098549 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:57:59.739067 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-73f11810-fc96-4daa-8407-f738ae098549 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:57:59.739510 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-73f11810-fc96-4daa-8407-f738ae098549 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:57:59.739923 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-73f11810-fc96-4daa-8407-f738ae098549 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:00.022421 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-73f11810-fc96-4daa-8407-f738ae098549 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "POST /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.297432 Sep 16 01:58:00.023026 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 270/525] 10.222.0.42 () {62 vars in 1364 bytes} [Fri Sep 16 01:57:59 2022] POST /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6/os-volume_attachments => generated 188 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 01:58:00.151853 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-29765b9a-2abc-4955-b5cd-2d9afeaee737 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:58:00.152460 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-29765b9a-2abc-4955-b5cd-2d9afeaee737 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:58:00.158871 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-29765b9a-2abc-4955-b5cd-2d9afeaee737 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:00.159364 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-29765b9a-2abc-4955-b5cd-2d9afeaee737 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:00.159799 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-29765b9a-2abc-4955-b5cd-2d9afeaee737 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:00.160577 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-29765b9a-2abc-4955-b5cd-2d9afeaee737 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:00.161052 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-29765b9a-2abc-4955-b5cd-2d9afeaee737 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:00.161476 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-29765b9a-2abc-4955-b5cd-2d9afeaee737 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:00.203760 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-29765b9a-2abc-4955-b5cd-2d9afeaee737 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120440) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 16 01:58:00.270566 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-29765b9a-2abc-4955-b5cd-2d9afeaee737 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "POST /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6/action" status: 202 len: 0 microversion: 2.20 time: 0.122497 Sep 16 01:58:00.271149 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 256/526] 10.222.0.42 () {62 vars in 1319 bytes} [Fri Sep 16 01:58:00 2022] POST /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6/action => generated 0 bytes in 124 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 16 01:58:00.279697 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-7f3fa6a3-39da-475c-ac3a-ced345360c84 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:58:00.280345 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-7f3fa6a3-39da-475c-ac3a-ced345360c84 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:58:00.286754 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7f3fa6a3-39da-475c-ac3a-ced345360c84 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:00.287233 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7f3fa6a3-39da-475c-ac3a-ced345360c84 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:00.287662 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7f3fa6a3-39da-475c-ac3a-ced345360c84 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:00.288379 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7f3fa6a3-39da-475c-ac3a-ced345360c84 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:00.288828 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7f3fa6a3-39da-475c-ac3a-ced345360c84 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:00.289248 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7f3fa6a3-39da-475c-ac3a-ced345360c84 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:00.425459 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-7f3fa6a3-39da-475c-ac3a-ced345360c84 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:00.434137 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-7f3fa6a3-39da-475c-ac3a-ced345360c84 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:00.436006 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-7f3fa6a3-39da-475c-ac3a-ced345360c84 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:00.437185 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-7f3fa6a3-39da-475c-ac3a-ced345360c84 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1751 microversion: 2.20 time: 0.161865 Sep 16 01:58:00.437731 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 271/527] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:58:00 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1751 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:58:01.463046 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-14e5b9e8-5e98-46dc-b9c9-e55afb1ea1b9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:58:01.463656 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-14e5b9e8-5e98-46dc-b9c9-e55afb1ea1b9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:58:01.470433 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-14e5b9e8-5e98-46dc-b9c9-e55afb1ea1b9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:01.470915 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-14e5b9e8-5e98-46dc-b9c9-e55afb1ea1b9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:01.471350 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-14e5b9e8-5e98-46dc-b9c9-e55afb1ea1b9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:01.472064 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-14e5b9e8-5e98-46dc-b9c9-e55afb1ea1b9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:01.472516 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-14e5b9e8-5e98-46dc-b9c9-e55afb1ea1b9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:01.472935 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-14e5b9e8-5e98-46dc-b9c9-e55afb1ea1b9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:01.601038 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-14e5b9e8-5e98-46dc-b9c9-e55afb1ea1b9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:01.609681 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-14e5b9e8-5e98-46dc-b9c9-e55afb1ea1b9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:01.611168 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-14e5b9e8-5e98-46dc-b9c9-e55afb1ea1b9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:01.612377 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-14e5b9e8-5e98-46dc-b9c9-e55afb1ea1b9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1753 microversion: 2.20 time: 0.153701 Sep 16 01:58:01.612931 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 257/528] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:58:01 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1753 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:58:02.638270 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-7cbff2ca-30b1-4c2d-a8b5-6b1c6913c5f1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:58:02.638877 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-7cbff2ca-30b1-4c2d-a8b5-6b1c6913c5f1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:58:02.644749 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7cbff2ca-30b1-4c2d-a8b5-6b1c6913c5f1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:02.645235 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7cbff2ca-30b1-4c2d-a8b5-6b1c6913c5f1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:02.645673 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7cbff2ca-30b1-4c2d-a8b5-6b1c6913c5f1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:02.646354 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7cbff2ca-30b1-4c2d-a8b5-6b1c6913c5f1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:02.646804 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7cbff2ca-30b1-4c2d-a8b5-6b1c6913c5f1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:02.647245 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7cbff2ca-30b1-4c2d-a8b5-6b1c6913c5f1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:02.844708 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-7cbff2ca-30b1-4c2d-a8b5-6b1c6913c5f1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:02.853112 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-7cbff2ca-30b1-4c2d-a8b5-6b1c6913c5f1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:02.854535 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-7cbff2ca-30b1-4c2d-a8b5-6b1c6913c5f1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:02.855668 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-7cbff2ca-30b1-4c2d-a8b5-6b1c6913c5f1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1809 microversion: 2.20 time: 0.221346 Sep 16 01:58:02.856270 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 272/529] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:58:02 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1809 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:58:03.882600 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-9d93648f-3354-4dbb-beb7-0f473f7fd77c tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:58:03.883392 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-9d93648f-3354-4dbb-beb7-0f473f7fd77c tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:58:03.892287 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9d93648f-3354-4dbb-beb7-0f473f7fd77c tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:03.892783 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9d93648f-3354-4dbb-beb7-0f473f7fd77c tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:03.893213 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9d93648f-3354-4dbb-beb7-0f473f7fd77c tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:03.893896 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9d93648f-3354-4dbb-beb7-0f473f7fd77c tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:03.894510 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9d93648f-3354-4dbb-beb7-0f473f7fd77c tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:03.894958 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9d93648f-3354-4dbb-beb7-0f473f7fd77c tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:04.035858 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-9d93648f-3354-4dbb-beb7-0f473f7fd77c tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:04.045078 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-9d93648f-3354-4dbb-beb7-0f473f7fd77c tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:04.046524 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-9d93648f-3354-4dbb-beb7-0f473f7fd77c tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:04.047672 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-9d93648f-3354-4dbb-beb7-0f473f7fd77c tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1809 microversion: 2.20 time: 0.169346 Sep 16 01:58:04.048268 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 258/530] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:58:03 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1809 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:58:05.073948 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-2bf4f196-8908-4fb0-8e41-b4576bcb89a2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:58:05.074497 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-2bf4f196-8908-4fb0-8e41-b4576bcb89a2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:58:05.081376 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2bf4f196-8908-4fb0-8e41-b4576bcb89a2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:05.081849 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2bf4f196-8908-4fb0-8e41-b4576bcb89a2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:05.082275 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2bf4f196-8908-4fb0-8e41-b4576bcb89a2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:05.083001 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2bf4f196-8908-4fb0-8e41-b4576bcb89a2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:05.083443 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2bf4f196-8908-4fb0-8e41-b4576bcb89a2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:05.083871 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2bf4f196-8908-4fb0-8e41-b4576bcb89a2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:05.219795 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-2bf4f196-8908-4fb0-8e41-b4576bcb89a2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:05.228928 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-2bf4f196-8908-4fb0-8e41-b4576bcb89a2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:05.230352 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-2bf4f196-8908-4fb0-8e41-b4576bcb89a2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:05.231572 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-2bf4f196-8908-4fb0-8e41-b4576bcb89a2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1809 microversion: 2.20 time: 0.161938 Sep 16 01:58:05.232150 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 273/531] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:58:05 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:58:06.257001 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-88bc9aa3-2748-45cb-80f5-84b879dee0c5 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:58:06.257837 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-88bc9aa3-2748-45cb-80f5-84b879dee0c5 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:58:06.264661 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-88bc9aa3-2748-45cb-80f5-84b879dee0c5 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:06.265141 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-88bc9aa3-2748-45cb-80f5-84b879dee0c5 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:06.265573 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-88bc9aa3-2748-45cb-80f5-84b879dee0c5 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:06.266260 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-88bc9aa3-2748-45cb-80f5-84b879dee0c5 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:06.266706 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-88bc9aa3-2748-45cb-80f5-84b879dee0c5 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:06.267119 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-88bc9aa3-2748-45cb-80f5-84b879dee0c5 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:06.582239 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-88bc9aa3-2748-45cb-80f5-84b879dee0c5 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:06.591871 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-88bc9aa3-2748-45cb-80f5-84b879dee0c5 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:06.593346 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-88bc9aa3-2748-45cb-80f5-84b879dee0c5 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:06.594502 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-88bc9aa3-2748-45cb-80f5-84b879dee0c5 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1809 microversion: 2.20 time: 0.341630 Sep 16 01:58:06.595176 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 259/532] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:58:06 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1809 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:58:07.620324 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-fbf9c9d2-b555-41e6-b876-b43fa95d8f3d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:58:07.621083 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-fbf9c9d2-b555-41e6-b876-b43fa95d8f3d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:58:07.627292 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fbf9c9d2-b555-41e6-b876-b43fa95d8f3d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:07.627797 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fbf9c9d2-b555-41e6-b876-b43fa95d8f3d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:07.628531 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fbf9c9d2-b555-41e6-b876-b43fa95d8f3d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:07.629206 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fbf9c9d2-b555-41e6-b876-b43fa95d8f3d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:07.629647 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fbf9c9d2-b555-41e6-b876-b43fa95d8f3d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:07.630062 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fbf9c9d2-b555-41e6-b876-b43fa95d8f3d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:07.767529 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-fbf9c9d2-b555-41e6-b876-b43fa95d8f3d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:07.775926 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-fbf9c9d2-b555-41e6-b876-b43fa95d8f3d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:07.777387 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-fbf9c9d2-b555-41e6-b876-b43fa95d8f3d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:07.779452 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-fbf9c9d2-b555-41e6-b876-b43fa95d8f3d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1809 microversion: 2.20 time: 0.162946 Sep 16 01:58:07.780040 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 274/533] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:58:07 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1809 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:58:08.805718 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-95aa50f0-b55d-47b9-a364-22acda021dc4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:58:08.806353 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-95aa50f0-b55d-47b9-a364-22acda021dc4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:58:08.814089 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-95aa50f0-b55d-47b9-a364-22acda021dc4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:08.814252 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-95aa50f0-b55d-47b9-a364-22acda021dc4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:08.814682 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-95aa50f0-b55d-47b9-a364-22acda021dc4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:08.815377 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-95aa50f0-b55d-47b9-a364-22acda021dc4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:08.815824 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-95aa50f0-b55d-47b9-a364-22acda021dc4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:08.816274 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-95aa50f0-b55d-47b9-a364-22acda021dc4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:08.951967 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-95aa50f0-b55d-47b9-a364-22acda021dc4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:08.961101 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-95aa50f0-b55d-47b9-a364-22acda021dc4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:08.962544 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-95aa50f0-b55d-47b9-a364-22acda021dc4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:08.963704 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-95aa50f0-b55d-47b9-a364-22acda021dc4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1809 microversion: 2.20 time: 0.161965 Sep 16 01:58:08.964277 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 260/534] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:58:08 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1809 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:58:09.990018 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-c1b476e9-2906-444f-b9c0-e35d5056ea16 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:58:09.990564 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-c1b476e9-2906-444f-b9c0-e35d5056ea16 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:58:09.996769 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c1b476e9-2906-444f-b9c0-e35d5056ea16 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:09.997330 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c1b476e9-2906-444f-b9c0-e35d5056ea16 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:09.997746 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c1b476e9-2906-444f-b9c0-e35d5056ea16 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:09.998538 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c1b476e9-2906-444f-b9c0-e35d5056ea16 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:09.998992 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c1b476e9-2906-444f-b9c0-e35d5056ea16 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:09.999586 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c1b476e9-2906-444f-b9c0-e35d5056ea16 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:10.143246 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-c1b476e9-2906-444f-b9c0-e35d5056ea16 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:10.147005 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell1:SELECT=91,nova_cell1:UPDATE=5,nova_cell1:INSERT=4 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:58:10.161855 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-c1b476e9-2906-444f-b9c0-e35d5056ea16 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:10.164417 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-c1b476e9-2906-444f-b9c0-e35d5056ea16 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:10.165631 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-c1b476e9-2906-444f-b9c0-e35d5056ea16 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1809 microversion: 2.20 time: 0.179736 Sep 16 01:58:10.166384 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 275/535] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:58:09 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1809 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:58:11.191562 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-9cce0298-e803-43bd-ab5e-4ed615d19472 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:58:11.192203 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-9cce0298-e803-43bd-ab5e-4ed615d19472 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:58:11.198474 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9cce0298-e803-43bd-ab5e-4ed615d19472 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:11.198956 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9cce0298-e803-43bd-ab5e-4ed615d19472 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:11.199396 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9cce0298-e803-43bd-ab5e-4ed615d19472 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:11.200118 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9cce0298-e803-43bd-ab5e-4ed615d19472 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:11.200571 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9cce0298-e803-43bd-ab5e-4ed615d19472 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:11.200997 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9cce0298-e803-43bd-ab5e-4ed615d19472 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:11.342308 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-9cce0298-e803-43bd-ab5e-4ed615d19472 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:11.350830 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-9cce0298-e803-43bd-ab5e-4ed615d19472 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:11.352339 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-9cce0298-e803-43bd-ab5e-4ed615d19472 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:11.353484 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-9cce0298-e803-43bd-ab5e-4ed615d19472 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1809 microversion: 2.20 time: 0.165905 Sep 16 01:58:11.354034 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 261/536] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:58:11 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1809 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 01:58:12.379250 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-79a6d9bf-c9ab-4516-ac82-0e917a1dedca tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:58:12.380010 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-79a6d9bf-c9ab-4516-ac82-0e917a1dedca tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:58:12.386889 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-79a6d9bf-c9ab-4516-ac82-0e917a1dedca tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:12.388070 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-79a6d9bf-c9ab-4516-ac82-0e917a1dedca tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:12.388425 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-79a6d9bf-c9ab-4516-ac82-0e917a1dedca tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:12.389180 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-79a6d9bf-c9ab-4516-ac82-0e917a1dedca tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:12.389638 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-79a6d9bf-c9ab-4516-ac82-0e917a1dedca tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:12.390209 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-79a6d9bf-c9ab-4516-ac82-0e917a1dedca tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:12.527437 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-79a6d9bf-c9ab-4516-ac82-0e917a1dedca tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:12.536935 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-79a6d9bf-c9ab-4516-ac82-0e917a1dedca tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:12.538375 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-79a6d9bf-c9ab-4516-ac82-0e917a1dedca tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:12.539540 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-79a6d9bf-c9ab-4516-ac82-0e917a1dedca tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1809 microversion: 2.20 time: 0.164466 Sep 16 01:58:12.540380 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 276/537] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:58:12 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:58:13.566418 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-a526c77b-e191-431a-8fd3-6f29fd57f33e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:58:13.573262 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-a526c77b-e191-431a-8fd3-6f29fd57f33e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:58:13.580707 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a526c77b-e191-431a-8fd3-6f29fd57f33e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:13.581197 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a526c77b-e191-431a-8fd3-6f29fd57f33e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:13.581641 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a526c77b-e191-431a-8fd3-6f29fd57f33e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:13.582371 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a526c77b-e191-431a-8fd3-6f29fd57f33e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:13.582814 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a526c77b-e191-431a-8fd3-6f29fd57f33e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:13.583245 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a526c77b-e191-431a-8fd3-6f29fd57f33e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:13.722995 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-a526c77b-e191-431a-8fd3-6f29fd57f33e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:13.733454 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-a526c77b-e191-431a-8fd3-6f29fd57f33e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:13.734924 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-a526c77b-e191-431a-8fd3-6f29fd57f33e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:13.736124 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-a526c77b-e191-431a-8fd3-6f29fd57f33e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1809 microversion: 2.20 time: 0.174287 Sep 16 01:58:13.736683 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 262/538] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:58:13 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1809 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 01:58:14.761564 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-f4f82f89-9815-437b-92d6-3021d4b4051e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:58:14.762246 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-f4f82f89-9815-437b-92d6-3021d4b4051e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:58:14.768399 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f4f82f89-9815-437b-92d6-3021d4b4051e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:14.768873 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f4f82f89-9815-437b-92d6-3021d4b4051e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:14.769298 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f4f82f89-9815-437b-92d6-3021d4b4051e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:14.769963 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f4f82f89-9815-437b-92d6-3021d4b4051e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:14.770403 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f4f82f89-9815-437b-92d6-3021d4b4051e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:14.770816 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f4f82f89-9815-437b-92d6-3021d4b4051e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:14.911127 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-f4f82f89-9815-437b-92d6-3021d4b4051e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:14.920406 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-f4f82f89-9815-437b-92d6-3021d4b4051e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:14.921847 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-f4f82f89-9815-437b-92d6-3021d4b4051e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:14.922995 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-f4f82f89-9815-437b-92d6-3021d4b4051e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1809 microversion: 2.20 time: 0.165364 Sep 16 01:58:14.923549 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 277/539] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:58:14 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1809 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:58:15.948715 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-0e7fadf3-deae-4edc-be4f-b9371d25ab8c tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:58:15.949319 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-0e7fadf3-deae-4edc-be4f-b9371d25ab8c tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:58:15.955844 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0e7fadf3-deae-4edc-be4f-b9371d25ab8c tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:15.956371 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0e7fadf3-deae-4edc-be4f-b9371d25ab8c tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:15.956804 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0e7fadf3-deae-4edc-be4f-b9371d25ab8c tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:15.957487 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0e7fadf3-deae-4edc-be4f-b9371d25ab8c tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:15.957935 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0e7fadf3-deae-4edc-be4f-b9371d25ab8c tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:15.958356 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0e7fadf3-deae-4edc-be4f-b9371d25ab8c tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:15.962368 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:58:16.092977 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-0e7fadf3-deae-4edc-be4f-b9371d25ab8c tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:16.101603 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-0e7fadf3-deae-4edc-be4f-b9371d25ab8c tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:16.103077 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-0e7fadf3-deae-4edc-be4f-b9371d25ab8c tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:16.104253 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-0e7fadf3-deae-4edc-be4f-b9371d25ab8c tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1809 microversion: 2.20 time: 0.159406 Sep 16 01:58:16.104801 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 263/540] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:58:15 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1809 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:58:17.130960 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-da5e7511-8815-4055-9f81-bc06067f4682 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:58:17.131568 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-da5e7511-8815-4055-9f81-bc06067f4682 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:58:17.137785 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-da5e7511-8815-4055-9f81-bc06067f4682 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:17.138280 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-da5e7511-8815-4055-9f81-bc06067f4682 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:17.138712 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-da5e7511-8815-4055-9f81-bc06067f4682 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:17.139387 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-da5e7511-8815-4055-9f81-bc06067f4682 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:17.139835 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-da5e7511-8815-4055-9f81-bc06067f4682 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:17.140282 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-da5e7511-8815-4055-9f81-bc06067f4682 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:17.269888 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-da5e7511-8815-4055-9f81-bc06067f4682 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:17.278389 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-da5e7511-8815-4055-9f81-bc06067f4682 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:17.280491 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-da5e7511-8815-4055-9f81-bc06067f4682 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:17.281648 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-da5e7511-8815-4055-9f81-bc06067f4682 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1809 microversion: 2.20 time: 0.154915 Sep 16 01:58:17.282194 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 278/541] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:58:17 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:58:18.308037 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-86cc5357-2245-43b9-95e8-49b6c89eb03a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:58:18.308649 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-86cc5357-2245-43b9-95e8-49b6c89eb03a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:58:18.315543 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-86cc5357-2245-43b9-95e8-49b6c89eb03a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:18.316058 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-86cc5357-2245-43b9-95e8-49b6c89eb03a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:18.316499 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-86cc5357-2245-43b9-95e8-49b6c89eb03a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:18.317189 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-86cc5357-2245-43b9-95e8-49b6c89eb03a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:18.317642 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-86cc5357-2245-43b9-95e8-49b6c89eb03a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:18.318069 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-86cc5357-2245-43b9-95e8-49b6c89eb03a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:18.448267 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-86cc5357-2245-43b9-95e8-49b6c89eb03a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:18.457645 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-86cc5357-2245-43b9-95e8-49b6c89eb03a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:18.459222 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-86cc5357-2245-43b9-95e8-49b6c89eb03a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:18.460625 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-86cc5357-2245-43b9-95e8-49b6c89eb03a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1809 microversion: 2.20 time: 0.156511 Sep 16 01:58:18.461235 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 264/542] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:58:18 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1809 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:58:19.486199 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-84f14b95-e097-4da6-aee7-e511e59b95d8 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:58:19.486727 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-84f14b95-e097-4da6-aee7-e511e59b95d8 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:58:19.493003 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-84f14b95-e097-4da6-aee7-e511e59b95d8 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:19.493490 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-84f14b95-e097-4da6-aee7-e511e59b95d8 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:19.493931 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-84f14b95-e097-4da6-aee7-e511e59b95d8 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:19.494696 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-84f14b95-e097-4da6-aee7-e511e59b95d8 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:19.495231 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-84f14b95-e097-4da6-aee7-e511e59b95d8 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:19.495749 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-84f14b95-e097-4da6-aee7-e511e59b95d8 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:19.624412 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-84f14b95-e097-4da6-aee7-e511e59b95d8 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:19.633106 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-84f14b95-e097-4da6-aee7-e511e59b95d8 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:19.634533 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-84f14b95-e097-4da6-aee7-e511e59b95d8 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:19.635702 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-84f14b95-e097-4da6-aee7-e511e59b95d8 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1809 microversion: 2.20 time: 0.153457 Sep 16 01:58:19.636287 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 279/543] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:58:19 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:58:20.660717 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-44271240-4e06-4f89-bdb6-142cb31b4ade tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:58:20.661359 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-44271240-4e06-4f89-bdb6-142cb31b4ade tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:58:20.668578 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-44271240-4e06-4f89-bdb6-142cb31b4ade tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:20.669161 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-44271240-4e06-4f89-bdb6-142cb31b4ade tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:20.669619 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-44271240-4e06-4f89-bdb6-142cb31b4ade tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:20.670423 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-44271240-4e06-4f89-bdb6-142cb31b4ade tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:20.670908 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-44271240-4e06-4f89-bdb6-142cb31b4ade tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:20.671333 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-44271240-4e06-4f89-bdb6-142cb31b4ade tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:20.800334 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-44271240-4e06-4f89-bdb6-142cb31b4ade tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:20.809647 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-44271240-4e06-4f89-bdb6-142cb31b4ade tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:20.811496 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-44271240-4e06-4f89-bdb6-142cb31b4ade tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:20.812455 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-44271240-4e06-4f89-bdb6-142cb31b4ade tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1809 microversion: 2.20 time: 0.155757 Sep 16 01:58:20.813012 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 265/544] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:58:20 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:58:21.838717 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-48a56a9a-c74e-4539-b5d4-b7004508e2ce tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:58:21.839328 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-48a56a9a-c74e-4539-b5d4-b7004508e2ce tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:58:21.842008 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_api:SELECT=38 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:58:21.847302 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-48a56a9a-c74e-4539-b5d4-b7004508e2ce tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:21.847789 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-48a56a9a-c74e-4539-b5d4-b7004508e2ce tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:21.848249 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-48a56a9a-c74e-4539-b5d4-b7004508e2ce tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:21.848932 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-48a56a9a-c74e-4539-b5d4-b7004508e2ce tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:21.849386 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-48a56a9a-c74e-4539-b5d4-b7004508e2ce tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:21.849811 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-48a56a9a-c74e-4539-b5d4-b7004508e2ce tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:21.979002 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-48a56a9a-c74e-4539-b5d4-b7004508e2ce tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:21.988076 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-48a56a9a-c74e-4539-b5d4-b7004508e2ce tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:21.989503 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-48a56a9a-c74e-4539-b5d4-b7004508e2ce tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:21.990642 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-48a56a9a-c74e-4539-b5d4-b7004508e2ce tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1809 microversion: 2.20 time: 0.155807 Sep 16 01:58:21.991196 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 280/545] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:58:21 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:58:23.017648 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-8d74d804-c372-42f8-9eac-e49837b1eae4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:58:23.018285 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-8d74d804-c372-42f8-9eac-e49837b1eae4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:58:23.024667 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8d74d804-c372-42f8-9eac-e49837b1eae4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:23.025148 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8d74d804-c372-42f8-9eac-e49837b1eae4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:23.025579 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8d74d804-c372-42f8-9eac-e49837b1eae4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:23.026260 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8d74d804-c372-42f8-9eac-e49837b1eae4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:23.026709 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8d74d804-c372-42f8-9eac-e49837b1eae4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:23.027132 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8d74d804-c372-42f8-9eac-e49837b1eae4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:23.157779 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-8d74d804-c372-42f8-9eac-e49837b1eae4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:23.166176 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-8d74d804-c372-42f8-9eac-e49837b1eae4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:23.167603 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-8d74d804-c372-42f8-9eac-e49837b1eae4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:23.169142 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-8d74d804-c372-42f8-9eac-e49837b1eae4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1809 microversion: 2.20 time: 0.155383 Sep 16 01:58:23.169695 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 266/546] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:58:23 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1809 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:58:24.194740 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-730c3253-c147-429f-9c1a-1467e415435a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:58:24.195350 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-730c3253-c147-429f-9c1a-1467e415435a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:58:24.201957 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-730c3253-c147-429f-9c1a-1467e415435a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:24.202443 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-730c3253-c147-429f-9c1a-1467e415435a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:24.202880 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-730c3253-c147-429f-9c1a-1467e415435a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:24.203563 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-730c3253-c147-429f-9c1a-1467e415435a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:24.204047 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-730c3253-c147-429f-9c1a-1467e415435a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:24.204474 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-730c3253-c147-429f-9c1a-1467e415435a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:24.332171 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-730c3253-c147-429f-9c1a-1467e415435a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:24.341184 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-730c3253-c147-429f-9c1a-1467e415435a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:24.342619 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-730c3253-c147-429f-9c1a-1467e415435a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:24.343758 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-730c3253-c147-429f-9c1a-1467e415435a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1809 microversion: 2.20 time: 0.153009 Sep 16 01:58:24.344339 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 281/547] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:58:24 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1809 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:58:25.369278 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-4867b0fb-7124-4fbe-9fe7-eb741a3453e9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:58:25.369872 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-4867b0fb-7124-4fbe-9fe7-eb741a3453e9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:58:25.376854 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-4867b0fb-7124-4fbe-9fe7-eb741a3453e9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:25.377335 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-4867b0fb-7124-4fbe-9fe7-eb741a3453e9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:25.377771 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-4867b0fb-7124-4fbe-9fe7-eb741a3453e9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:25.378716 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-4867b0fb-7124-4fbe-9fe7-eb741a3453e9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:25.379168 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-4867b0fb-7124-4fbe-9fe7-eb741a3453e9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:25.379592 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-4867b0fb-7124-4fbe-9fe7-eb741a3453e9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:25.508832 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-4867b0fb-7124-4fbe-9fe7-eb741a3453e9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:25.517945 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-4867b0fb-7124-4fbe-9fe7-eb741a3453e9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:25.519387 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-4867b0fb-7124-4fbe-9fe7-eb741a3453e9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:25.520571 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-4867b0fb-7124-4fbe-9fe7-eb741a3453e9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1809 microversion: 2.20 time: 0.155175 Sep 16 01:58:25.521137 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 267/548] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:58:25 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1809 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:58:26.547058 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-0603830f-785d-4de3-9009-1761c47ac17a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:58:26.547659 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-0603830f-785d-4de3-9009-1761c47ac17a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:58:26.553511 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0603830f-785d-4de3-9009-1761c47ac17a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:26.553981 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0603830f-785d-4de3-9009-1761c47ac17a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:26.554406 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0603830f-785d-4de3-9009-1761c47ac17a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:26.555078 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0603830f-785d-4de3-9009-1761c47ac17a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:26.555528 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0603830f-785d-4de3-9009-1761c47ac17a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:26.555952 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0603830f-785d-4de3-9009-1761c47ac17a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:26.688596 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-0603830f-785d-4de3-9009-1761c47ac17a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:26.697035 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-0603830f-785d-4de3-9009-1761c47ac17a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:26.698471 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-0603830f-785d-4de3-9009-1761c47ac17a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:26.699617 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-0603830f-785d-4de3-9009-1761c47ac17a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1809 microversion: 2.20 time: 0.157374 Sep 16 01:58:26.700218 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 282/549] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:58:26 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:58:27.725589 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-4a44d0a6-0cf3-479d-b07c-ea331aa6f13b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:58:27.726227 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-4a44d0a6-0cf3-479d-b07c-ea331aa6f13b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:58:27.733605 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-4a44d0a6-0cf3-479d-b07c-ea331aa6f13b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:27.734081 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-4a44d0a6-0cf3-479d-b07c-ea331aa6f13b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:27.734510 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-4a44d0a6-0cf3-479d-b07c-ea331aa6f13b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:27.735182 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-4a44d0a6-0cf3-479d-b07c-ea331aa6f13b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:27.735626 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-4a44d0a6-0cf3-479d-b07c-ea331aa6f13b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:27.736080 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-4a44d0a6-0cf3-479d-b07c-ea331aa6f13b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:27.867762 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-4a44d0a6-0cf3-479d-b07c-ea331aa6f13b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:27.876362 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-4a44d0a6-0cf3-479d-b07c-ea331aa6f13b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:27.877794 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-4a44d0a6-0cf3-479d-b07c-ea331aa6f13b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:27.879182 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-4a44d0a6-0cf3-479d-b07c-ea331aa6f13b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1809 microversion: 2.20 time: 0.157486 Sep 16 01:58:27.879727 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 268/550] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:58:27 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1809 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:58:28.905436 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-af4a4eea-abd2-43bd-a88d-96f54f245df7 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:58:28.906043 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-af4a4eea-abd2-43bd-a88d-96f54f245df7 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:58:28.912065 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-af4a4eea-abd2-43bd-a88d-96f54f245df7 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:28.912553 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-af4a4eea-abd2-43bd-a88d-96f54f245df7 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:28.912994 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-af4a4eea-abd2-43bd-a88d-96f54f245df7 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:28.913673 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-af4a4eea-abd2-43bd-a88d-96f54f245df7 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:28.914126 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-af4a4eea-abd2-43bd-a88d-96f54f245df7 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:28.914550 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-af4a4eea-abd2-43bd-a88d-96f54f245df7 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:29.043405 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-af4a4eea-abd2-43bd-a88d-96f54f245df7 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:29.052030 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-af4a4eea-abd2-43bd-a88d-96f54f245df7 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:29.053474 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-af4a4eea-abd2-43bd-a88d-96f54f245df7 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:29.054656 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-af4a4eea-abd2-43bd-a88d-96f54f245df7 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1809 microversion: 2.20 time: 0.153610 Sep 16 01:58:29.055207 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 283/551] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:58:28 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:58:30.080154 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-1df87607-4fd4-43cb-811d-6272f1b4408a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:58:30.080681 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-1df87607-4fd4-43cb-811d-6272f1b4408a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:58:30.083352 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_api:SELECT=32,nova_api:UPDATE=1 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:58:30.088638 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1df87607-4fd4-43cb-811d-6272f1b4408a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:30.089127 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1df87607-4fd4-43cb-811d-6272f1b4408a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:30.089600 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1df87607-4fd4-43cb-811d-6272f1b4408a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:30.090479 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1df87607-4fd4-43cb-811d-6272f1b4408a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:30.090936 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1df87607-4fd4-43cb-811d-6272f1b4408a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:30.091363 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1df87607-4fd4-43cb-811d-6272f1b4408a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:30.223017 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-1df87607-4fd4-43cb-811d-6272f1b4408a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:30.232105 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-1df87607-4fd4-43cb-811d-6272f1b4408a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:30.233577 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-1df87607-4fd4-43cb-811d-6272f1b4408a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:30.234721 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-1df87607-4fd4-43cb-811d-6272f1b4408a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1809 microversion: 2.20 time: 0.158596 Sep 16 01:58:30.235276 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 269/552] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:58:30 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1809 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:58:30.534863 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [req-802240cf-7ed3-4e41-8bfb-6fdec558bef7 req-472a791f-7e35-4b7e-9b43-e563ae1fc47e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e390b45-0b39-4429-9431-7ee6af3806e6", "name": "network-vif-plugged", "status": "completed", "tag": "dc91b77b-583a-4740-a244-adc53daa4347"}]} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:58:30.545817 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-802240cf-7ed3-4e41-8bfb-6fdec558bef7 req-472a791f-7e35-4b7e-9b43-e563ae1fc47e service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:30.546504 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-802240cf-7ed3-4e41-8bfb-6fdec558bef7 req-472a791f-7e35-4b7e-9b43-e563ae1fc47e service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:30.547117 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-802240cf-7ed3-4e41-8bfb-6fdec558bef7 req-472a791f-7e35-4b7e-9b43-e563ae1fc47e service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:30.558494 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.compute.server_external_events [req-802240cf-7ed3-4e41-8bfb-6fdec558bef7 req-472a791f-7e35-4b7e-9b43-e563ae1fc47e service nova] Creating event network-vif-plugged:dc91b77b-583a-4740-a244-adc53daa4347 for instance 3e390b45-0b39-4429-9431-7ee6af3806e6 on hv-cinder-84914 Sep 16 01:58:30.564109 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [req-802240cf-7ed3-4e41-8bfb-6fdec558bef7 req-472a791f-7e35-4b7e-9b43-e563ae1fc47e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032949 Sep 16 01:58:30.564268 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 284/553] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 01:58:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:58:31.261124 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-b8ff85b6-96a8-4f3a-bb25-da07fad049c9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:58:31.262468 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-b8ff85b6-96a8-4f3a-bb25-da07fad049c9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:58:31.268705 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b8ff85b6-96a8-4f3a-bb25-da07fad049c9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:31.269195 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b8ff85b6-96a8-4f3a-bb25-da07fad049c9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:31.269634 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b8ff85b6-96a8-4f3a-bb25-da07fad049c9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:31.270320 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b8ff85b6-96a8-4f3a-bb25-da07fad049c9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:31.270775 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b8ff85b6-96a8-4f3a-bb25-da07fad049c9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:31.271202 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b8ff85b6-96a8-4f3a-bb25-da07fad049c9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:31.400408 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-b8ff85b6-96a8-4f3a-bb25-da07fad049c9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:31.408893 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-b8ff85b6-96a8-4f3a-bb25-da07fad049c9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:31.410331 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-b8ff85b6-96a8-4f3a-bb25-da07fad049c9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:31.411494 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-b8ff85b6-96a8-4f3a-bb25-da07fad049c9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1809 microversion: 2.20 time: 0.154279 Sep 16 01:58:31.412079 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 270/554] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:58:31 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1809 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:58:32.437838 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-adc9a556-34bf-493e-9bd2-488e639dfb01 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:58:32.438533 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-adc9a556-34bf-493e-9bd2-488e639dfb01 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:58:32.444575 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-adc9a556-34bf-493e-9bd2-488e639dfb01 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:32.445054 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-adc9a556-34bf-493e-9bd2-488e639dfb01 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:32.445490 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-adc9a556-34bf-493e-9bd2-488e639dfb01 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:32.446163 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-adc9a556-34bf-493e-9bd2-488e639dfb01 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:32.446619 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-adc9a556-34bf-493e-9bd2-488e639dfb01 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:32.447061 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-adc9a556-34bf-493e-9bd2-488e639dfb01 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:32.584837 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-adc9a556-34bf-493e-9bd2-488e639dfb01 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:32.594210 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-adc9a556-34bf-493e-9bd2-488e639dfb01 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:32.595675 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-adc9a556-34bf-493e-9bd2-488e639dfb01 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:32.596892 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-adc9a556-34bf-493e-9bd2-488e639dfb01 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1809 microversion: 2.20 time: 0.163678 Sep 16 01:58:32.597438 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 285/555] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:58:32 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1809 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:58:33.622438 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-53e6597e-761b-405a-8c87-f849b0b5ffa4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:58:33.623056 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-53e6597e-761b-405a-8c87-f849b0b5ffa4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:58:33.629435 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-53e6597e-761b-405a-8c87-f849b0b5ffa4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:33.629917 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-53e6597e-761b-405a-8c87-f849b0b5ffa4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:33.630355 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-53e6597e-761b-405a-8c87-f849b0b5ffa4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:33.631036 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-53e6597e-761b-405a-8c87-f849b0b5ffa4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:33.631483 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-53e6597e-761b-405a-8c87-f849b0b5ffa4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:33.631906 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-53e6597e-761b-405a-8c87-f849b0b5ffa4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:33.757587 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-53e6597e-761b-405a-8c87-f849b0b5ffa4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:33.766616 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-53e6597e-761b-405a-8c87-f849b0b5ffa4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:33.768077 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-53e6597e-761b-405a-8c87-f849b0b5ffa4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:58:33.769232 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-53e6597e-761b-405a-8c87-f849b0b5ffa4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1796 microversion: 2.20 time: 0.150915 Sep 16 01:58:33.769789 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 271/556] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:58:33 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1796 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:58:51.913317 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-9a535356-6f7b-467c-a911-51f29943b45f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4b52ad91-2825-48c4-b8f0-8c04ada51edb"}} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:58:51.915640 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-9a535356-6f7b-467c-a911-51f29943b45f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 40664bec-019b-4246-ad2b-3badd9b2e317] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:58:51.917972 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_api:SELECT=11 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:58:51.918719 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell1:SELECT=56 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:58:51.923807 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9a535356-6f7b-467c-a911-51f29943b45f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:51.924313 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9a535356-6f7b-467c-a911-51f29943b45f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:51.924742 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9a535356-6f7b-467c-a911-51f29943b45f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:51.925417 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9a535356-6f7b-467c-a911-51f29943b45f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:51.925861 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9a535356-6f7b-467c-a911-51f29943b45f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:51.926275 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9a535356-6f7b-467c-a911-51f29943b45f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:52.306274 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-9a535356-6f7b-467c-a911-51f29943b45f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "POST /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.396819 Sep 16 01:58:52.306870 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 286/557] 10.222.0.42 () {60 vars in 1323 bytes} [Fri Sep 16 01:58:51 2022] POST /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317/os-volume_attachments => generated 194 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:58:59.847090 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-ebc24afa-d921-42a9-aaa5-ad987691602d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:58:59.849397 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-ebc24afa-d921-42a9-aaa5-ad987691602d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 40664bec-019b-4246-ad2b-3badd9b2e317] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:58:59.851837 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_api:SELECT=5 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:58:59.852673 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell1:SELECT=52 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:58:59.859534 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ebc24afa-d921-42a9-aaa5-ad987691602d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:59.860035 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ebc24afa-d921-42a9-aaa5-ad987691602d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:59.860466 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ebc24afa-d921-42a9-aaa5-ad987691602d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:59.861141 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ebc24afa-d921-42a9-aaa5-ad987691602d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:58:59.861586 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ebc24afa-d921-42a9-aaa5-ad987691602d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:58:59.862008 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ebc24afa-d921-42a9-aaa5-ad987691602d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:58:59.884931 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.objects.instance [None req-ebc24afa-d921-42a9-aaa5-ad987691602d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lazy-loading 'flavor' on Instance uuid 40664bec-019b-4246-ad2b-3badd9b2e317 {{(pid=120440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 01:59:00.056973 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-ebc24afa-d921-42a9-aaa5-ad987691602d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "POST /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317/action" status: 200 len: 32 microversion: 2.1 time: 0.213773 Sep 16 01:59:00.057557 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 272/558] 10.222.0.42 () {60 vars in 1278 bytes} [Fri Sep 16 01:58:59 2022] POST /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317/action => generated 32 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 01:59:00.068088 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-8746390c-f2ec-41b0-973b-cfb76875fbce tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:00.068922 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-8746390c-f2ec-41b0-973b-cfb76875fbce tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 40664bec-019b-4246-ad2b-3badd9b2e317] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:00.077326 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8746390c-f2ec-41b0-973b-cfb76875fbce tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:00.077815 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8746390c-f2ec-41b0-973b-cfb76875fbce tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:00.078285 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8746390c-f2ec-41b0-973b-cfb76875fbce tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:00.079294 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8746390c-f2ec-41b0-973b-cfb76875fbce tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:00.079756 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8746390c-f2ec-41b0-973b-cfb76875fbce tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:00.080207 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8746390c-f2ec-41b0-973b-cfb76875fbce tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:00.293444 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-8746390c-f2ec-41b0-973b-cfb76875fbce tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:00.301666 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-8746390c-f2ec-41b0-973b-cfb76875fbce tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317" status: 200 len: 1734 microversion: 2.1 time: 0.237867 Sep 16 01:59:00.302230 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 287/559] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:59:00 2022] GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317 => generated 1734 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 01:59:01.326947 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-ac2c4fe5-ab39-463f-8b99-5f498bcfa30a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:01.327637 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-ac2c4fe5-ab39-463f-8b99-5f498bcfa30a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 40664bec-019b-4246-ad2b-3badd9b2e317] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:01.333812 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ac2c4fe5-ab39-463f-8b99-5f498bcfa30a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:01.334288 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ac2c4fe5-ab39-463f-8b99-5f498bcfa30a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:01.334717 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ac2c4fe5-ab39-463f-8b99-5f498bcfa30a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:01.335390 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ac2c4fe5-ab39-463f-8b99-5f498bcfa30a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:01.335835 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ac2c4fe5-ab39-463f-8b99-5f498bcfa30a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:01.336278 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ac2c4fe5-ab39-463f-8b99-5f498bcfa30a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:01.462570 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-ac2c4fe5-ab39-463f-8b99-5f498bcfa30a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:01.471311 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-ac2c4fe5-ab39-463f-8b99-5f498bcfa30a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317" status: 200 len: 1734 microversion: 2.1 time: 0.149070 Sep 16 01:59:01.471865 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 273/560] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:59:01 2022] GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:59:02.494590 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-ff130fb1-68cc-4c50-960b-58397ef93b9a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:02.495240 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-ff130fb1-68cc-4c50-960b-58397ef93b9a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 40664bec-019b-4246-ad2b-3badd9b2e317] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:02.503053 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ff130fb1-68cc-4c50-960b-58397ef93b9a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:02.503540 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ff130fb1-68cc-4c50-960b-58397ef93b9a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:02.504006 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ff130fb1-68cc-4c50-960b-58397ef93b9a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:02.504710 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ff130fb1-68cc-4c50-960b-58397ef93b9a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:02.505169 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ff130fb1-68cc-4c50-960b-58397ef93b9a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:02.505603 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ff130fb1-68cc-4c50-960b-58397ef93b9a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:02.634328 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-ff130fb1-68cc-4c50-960b-58397ef93b9a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:02.642629 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-ff130fb1-68cc-4c50-960b-58397ef93b9a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317" status: 200 len: 1734 microversion: 2.1 time: 0.151921 Sep 16 01:59:02.643194 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 288/561] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:59:02 2022] GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:59:03.666674 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-74a6f601-bd7e-4443-9702-d5d4b6b3892f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:03.667279 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-74a6f601-bd7e-4443-9702-d5d4b6b3892f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 40664bec-019b-4246-ad2b-3badd9b2e317] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:03.673902 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-74a6f601-bd7e-4443-9702-d5d4b6b3892f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:03.674383 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-74a6f601-bd7e-4443-9702-d5d4b6b3892f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:03.674817 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-74a6f601-bd7e-4443-9702-d5d4b6b3892f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:03.675498 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-74a6f601-bd7e-4443-9702-d5d4b6b3892f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:03.675955 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-74a6f601-bd7e-4443-9702-d5d4b6b3892f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:03.676396 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-74a6f601-bd7e-4443-9702-d5d4b6b3892f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:03.807014 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-74a6f601-bd7e-4443-9702-d5d4b6b3892f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:03.816016 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-74a6f601-bd7e-4443-9702-d5d4b6b3892f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317" status: 200 len: 1734 microversion: 2.1 time: 0.153302 Sep 16 01:59:03.816635 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 274/562] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:59:03 2022] GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317 => generated 1734 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:59:03.978942 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-d3e9dc98-0fba-4de8-b899-73b9df81f27f tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:03.979434 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-d3e9dc98-0fba-4de8-b899-73b9df81f27f tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:03.986261 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d3e9dc98-0fba-4de8-b899-73b9df81f27f tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:03.986737 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d3e9dc98-0fba-4de8-b899-73b9df81f27f tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:03.987168 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d3e9dc98-0fba-4de8-b899-73b9df81f27f tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:03.987846 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d3e9dc98-0fba-4de8-b899-73b9df81f27f tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:03.988324 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d3e9dc98-0fba-4de8-b899-73b9df81f27f tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:03.988743 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d3e9dc98-0fba-4de8-b899-73b9df81f27f tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:04.112503 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.objects.instance [None req-d3e9dc98-0fba-4de8-b899-73b9df81f27f tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lazy-loading 'services' on Instance uuid df8bdee8-15d2-4b18-a2d0-8b24b43f6763 {{(pid=120441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 01:59:04.227450 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-d3e9dc98-0fba-4de8-b899-73b9df81f27f tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "DELETE /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763/os-volume_attachments/e6ab01ee-9b00-4e36-96c0-b677ce0a4c5b" status: 202 len: 0 microversion: 2.1 time: 0.352035 Sep 16 01:59:04.228000 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 289/563] 10.222.0.42 () {58 vars in 1416 bytes} [Fri Sep 16 01:59:03 2022] DELETE /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763/os-volume_attachments/e6ab01ee-9b00-4e36-96c0-b677ce0a4c5b => generated 0 bytes in 354 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 01:59:04.839058 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-1d6aa1b6-e8a2-4300-b48b-2ec8eda56630 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:04.839672 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-1d6aa1b6-e8a2-4300-b48b-2ec8eda56630 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 40664bec-019b-4246-ad2b-3badd9b2e317] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:04.846055 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1d6aa1b6-e8a2-4300-b48b-2ec8eda56630 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:04.846533 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1d6aa1b6-e8a2-4300-b48b-2ec8eda56630 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:04.846967 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1d6aa1b6-e8a2-4300-b48b-2ec8eda56630 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:04.847654 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1d6aa1b6-e8a2-4300-b48b-2ec8eda56630 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:04.848139 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1d6aa1b6-e8a2-4300-b48b-2ec8eda56630 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:04.848565 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1d6aa1b6-e8a2-4300-b48b-2ec8eda56630 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:04.983800 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-1d6aa1b6-e8a2-4300-b48b-2ec8eda56630 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:04.992150 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-1d6aa1b6-e8a2-4300-b48b-2ec8eda56630 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317" status: 200 len: 1734 microversion: 2.1 time: 0.156954 Sep 16 01:59:04.992718 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 275/564] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:59:04 2022] GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:59:05.351629 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-59a1093d-3682-4814-a3b6-4a94d7487e59 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:59:05.358392 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-59a1093d-3682-4814-a3b6-4a94d7487e59 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:05.358882 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-59a1093d-3682-4814-a3b6-4a94d7487e59 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:05.359305 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-59a1093d-3682-4814-a3b6-4a94d7487e59 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:05.382335 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-59a1093d-3682-4814-a3b6-4a94d7487e59 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Going to try to stop instance {{(pid=120441) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 16 01:59:05.422580 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-59a1093d-3682-4814-a3b6-4a94d7487e59 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "POST /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763/action" status: 202 len: 0 microversion: 2.1 time: 0.075741 Sep 16 01:59:05.423168 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 290/565] 10.222.0.42 () {60 vars in 1278 bytes} [Fri Sep 16 01:59:05 2022] POST /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763/action => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 01:59:05.431127 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-097d3aa9-1a22-4f1f-aa90-db25133c7548 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:05.431760 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-097d3aa9-1a22-4f1f-aa90-db25133c7548 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:05.438697 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-097d3aa9-1a22-4f1f-aa90-db25133c7548 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:05.439174 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-097d3aa9-1a22-4f1f-aa90-db25133c7548 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:05.439606 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-097d3aa9-1a22-4f1f-aa90-db25133c7548 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:05.440317 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-097d3aa9-1a22-4f1f-aa90-db25133c7548 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:05.440763 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-097d3aa9-1a22-4f1f-aa90-db25133c7548 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:05.441190 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-097d3aa9-1a22-4f1f-aa90-db25133c7548 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:05.572207 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-097d3aa9-1a22-4f1f-aa90-db25133c7548 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:05.579978 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-097d3aa9-1a22-4f1f-aa90-db25133c7548 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1678 microversion: 2.1 time: 0.152620 Sep 16 01:59:05.580737 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 276/566] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:59:05 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:59:06.016785 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-575ff016-f219-4e40-b969-f07b9b461578 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:06.017490 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-575ff016-f219-4e40-b969-f07b9b461578 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 40664bec-019b-4246-ad2b-3badd9b2e317] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:06.023963 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-575ff016-f219-4e40-b969-f07b9b461578 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:06.024496 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-575ff016-f219-4e40-b969-f07b9b461578 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:06.024932 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-575ff016-f219-4e40-b969-f07b9b461578 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:06.025616 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-575ff016-f219-4e40-b969-f07b9b461578 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:06.026064 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-575ff016-f219-4e40-b969-f07b9b461578 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:06.026483 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-575ff016-f219-4e40-b969-f07b9b461578 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:06.158136 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-575ff016-f219-4e40-b969-f07b9b461578 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:06.166143 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-575ff016-f219-4e40-b969-f07b9b461578 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317" status: 200 len: 1734 microversion: 2.1 time: 0.154454 Sep 16 01:59:06.166759 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 291/567] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:59:06 2022] GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:59:06.603825 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-5c2f115d-0fdc-41ba-9a71-db1c108229ec tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:06.604475 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-5c2f115d-0fdc-41ba-9a71-db1c108229ec tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:06.611661 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-5c2f115d-0fdc-41ba-9a71-db1c108229ec tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:06.612178 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-5c2f115d-0fdc-41ba-9a71-db1c108229ec tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:06.612621 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-5c2f115d-0fdc-41ba-9a71-db1c108229ec tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:06.613308 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-5c2f115d-0fdc-41ba-9a71-db1c108229ec tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:06.613765 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-5c2f115d-0fdc-41ba-9a71-db1c108229ec tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:06.614189 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-5c2f115d-0fdc-41ba-9a71-db1c108229ec tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:06.741211 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-5c2f115d-0fdc-41ba-9a71-db1c108229ec tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:06.748838 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-5c2f115d-0fdc-41ba-9a71-db1c108229ec tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1678 microversion: 2.1 time: 0.148898 Sep 16 01:59:06.749542 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 277/568] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:59:06 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:59:07.189962 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-d1e7f3ca-1fe8-49f3-a935-8642b6e4a7b0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:07.190614 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-d1e7f3ca-1fe8-49f3-a935-8642b6e4a7b0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 40664bec-019b-4246-ad2b-3badd9b2e317] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:07.196881 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d1e7f3ca-1fe8-49f3-a935-8642b6e4a7b0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:07.197362 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d1e7f3ca-1fe8-49f3-a935-8642b6e4a7b0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:07.197795 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d1e7f3ca-1fe8-49f3-a935-8642b6e4a7b0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:07.198476 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d1e7f3ca-1fe8-49f3-a935-8642b6e4a7b0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:07.198928 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d1e7f3ca-1fe8-49f3-a935-8642b6e4a7b0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:07.199352 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d1e7f3ca-1fe8-49f3-a935-8642b6e4a7b0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:07.333061 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-d1e7f3ca-1fe8-49f3-a935-8642b6e4a7b0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:07.341052 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-d1e7f3ca-1fe8-49f3-a935-8642b6e4a7b0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317" status: 200 len: 1734 microversion: 2.1 time: 0.155644 Sep 16 01:59:07.341616 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 292/569] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:59:07 2022] GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317 => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:59:07.771741 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-889f3e7a-386a-40fc-b393-f3c1226c5c21 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:07.772496 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-889f3e7a-386a-40fc-b393-f3c1226c5c21 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:07.779330 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-889f3e7a-386a-40fc-b393-f3c1226c5c21 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:07.779809 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-889f3e7a-386a-40fc-b393-f3c1226c5c21 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:07.780360 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-889f3e7a-386a-40fc-b393-f3c1226c5c21 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:07.781920 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-889f3e7a-386a-40fc-b393-f3c1226c5c21 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:07.782489 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-889f3e7a-386a-40fc-b393-f3c1226c5c21 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:07.782916 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-889f3e7a-386a-40fc-b393-f3c1226c5c21 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:07.915290 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-889f3e7a-386a-40fc-b393-f3c1226c5c21 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:07.923466 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-889f3e7a-386a-40fc-b393-f3c1226c5c21 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1678 microversion: 2.1 time: 0.156018 Sep 16 01:59:07.924050 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 278/570] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:59:07 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1678 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:59:08.364126 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-be141339-332d-4855-b794-b4bec77c7df0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:08.364750 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-be141339-332d-4855-b794-b4bec77c7df0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 40664bec-019b-4246-ad2b-3badd9b2e317] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:08.370995 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-be141339-332d-4855-b794-b4bec77c7df0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:08.371474 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-be141339-332d-4855-b794-b4bec77c7df0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:08.371902 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-be141339-332d-4855-b794-b4bec77c7df0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:08.372619 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-be141339-332d-4855-b794-b4bec77c7df0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:08.373062 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-be141339-332d-4855-b794-b4bec77c7df0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:08.373476 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-be141339-332d-4855-b794-b4bec77c7df0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:08.499257 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-be141339-332d-4855-b794-b4bec77c7df0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:08.508390 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-be141339-332d-4855-b794-b4bec77c7df0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317" status: 200 len: 1734 microversion: 2.1 time: 0.148106 Sep 16 01:59:08.508953 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 293/571] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:59:08 2022] GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:59:08.947167 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-b3070402-849c-4556-8367-410dc16b5c83 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:08.947776 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-b3070402-849c-4556-8367-410dc16b5c83 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:08.954310 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b3070402-849c-4556-8367-410dc16b5c83 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:08.954793 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b3070402-849c-4556-8367-410dc16b5c83 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:08.955230 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b3070402-849c-4556-8367-410dc16b5c83 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:08.955909 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b3070402-849c-4556-8367-410dc16b5c83 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:08.956385 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b3070402-849c-4556-8367-410dc16b5c83 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:08.956806 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b3070402-849c-4556-8367-410dc16b5c83 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:09.090345 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-b3070402-849c-4556-8367-410dc16b5c83 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:09.098007 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-b3070402-849c-4556-8367-410dc16b5c83 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1678 microversion: 2.1 time: 0.154718 Sep 16 01:59:09.098571 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 279/572] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:59:08 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1678 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:59:09.533608 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-8e7fdcd6-ca2c-4076-af7a-161ee0dcbb9f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:09.534247 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-8e7fdcd6-ca2c-4076-af7a-161ee0dcbb9f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 40664bec-019b-4246-ad2b-3badd9b2e317] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:09.540566 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8e7fdcd6-ca2c-4076-af7a-161ee0dcbb9f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:09.541044 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8e7fdcd6-ca2c-4076-af7a-161ee0dcbb9f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:09.541476 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8e7fdcd6-ca2c-4076-af7a-161ee0dcbb9f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:09.542151 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8e7fdcd6-ca2c-4076-af7a-161ee0dcbb9f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:09.542597 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8e7fdcd6-ca2c-4076-af7a-161ee0dcbb9f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:09.543016 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8e7fdcd6-ca2c-4076-af7a-161ee0dcbb9f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:09.669094 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-8e7fdcd6-ca2c-4076-af7a-161ee0dcbb9f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:09.677634 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-8e7fdcd6-ca2c-4076-af7a-161ee0dcbb9f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317" status: 200 len: 1734 microversion: 2.1 time: 0.147869 Sep 16 01:59:09.678192 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 294/573] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:59:09 2022] GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:59:10.120607 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-d327d527-b2d0-460c-a636-f83435c910c8 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:10.121218 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-d327d527-b2d0-460c-a636-f83435c910c8 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:10.127877 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d327d527-b2d0-460c-a636-f83435c910c8 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:10.128401 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d327d527-b2d0-460c-a636-f83435c910c8 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:10.128837 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d327d527-b2d0-460c-a636-f83435c910c8 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:10.129515 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d327d527-b2d0-460c-a636-f83435c910c8 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:10.129966 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d327d527-b2d0-460c-a636-f83435c910c8 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:10.130391 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d327d527-b2d0-460c-a636-f83435c910c8 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:10.255419 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-d327d527-b2d0-460c-a636-f83435c910c8 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:10.263015 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-d327d527-b2d0-460c-a636-f83435c910c8 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1678 microversion: 2.1 time: 0.146203 Sep 16 01:59:10.263567 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 280/574] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:59:10 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1678 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:59:10.799583 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-9b0326ea-6ea4-47f7-bc62-b5ac33b3e2d9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:10.800222 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-9b0326ea-6ea4-47f7-bc62-b5ac33b3e2d9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 40664bec-019b-4246-ad2b-3badd9b2e317] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:10.806209 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9b0326ea-6ea4-47f7-bc62-b5ac33b3e2d9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:10.806688 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9b0326ea-6ea4-47f7-bc62-b5ac33b3e2d9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:10.807111 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9b0326ea-6ea4-47f7-bc62-b5ac33b3e2d9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:10.807788 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9b0326ea-6ea4-47f7-bc62-b5ac33b3e2d9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:10.808264 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9b0326ea-6ea4-47f7-bc62-b5ac33b3e2d9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:10.808689 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9b0326ea-6ea4-47f7-bc62-b5ac33b3e2d9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:10.940225 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-9b0326ea-6ea4-47f7-bc62-b5ac33b3e2d9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:10.948418 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-9b0326ea-6ea4-47f7-bc62-b5ac33b3e2d9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317" status: 200 len: 1734 microversion: 2.1 time: 0.250599 Sep 16 01:59:10.948980 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 295/575] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:59:10 2022] GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317 => generated 1734 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 01:59:11.286683 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-e3e42060-4fdd-4b61-8018-c42810b25109 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:11.287292 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-e3e42060-4fdd-4b61-8018-c42810b25109 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:11.293611 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e3e42060-4fdd-4b61-8018-c42810b25109 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:11.294098 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e3e42060-4fdd-4b61-8018-c42810b25109 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:11.294532 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e3e42060-4fdd-4b61-8018-c42810b25109 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:11.295219 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e3e42060-4fdd-4b61-8018-c42810b25109 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:11.295681 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e3e42060-4fdd-4b61-8018-c42810b25109 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:11.296220 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e3e42060-4fdd-4b61-8018-c42810b25109 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:11.427741 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-e3e42060-4fdd-4b61-8018-c42810b25109 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:11.435319 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-e3e42060-4fdd-4b61-8018-c42810b25109 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1678 microversion: 2.1 time: 0.152583 Sep 16 01:59:11.435886 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 281/576] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:59:11 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 01:59:11.972659 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-1624ca98-e0b2-4360-81dc-778e1b928c04 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:11.973262 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-1624ca98-e0b2-4360-81dc-778e1b928c04 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 40664bec-019b-4246-ad2b-3badd9b2e317] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:11.979695 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1624ca98-e0b2-4360-81dc-778e1b928c04 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:11.980198 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1624ca98-e0b2-4360-81dc-778e1b928c04 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:11.980626 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1624ca98-e0b2-4360-81dc-778e1b928c04 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:11.981293 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1624ca98-e0b2-4360-81dc-778e1b928c04 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:11.981828 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1624ca98-e0b2-4360-81dc-778e1b928c04 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:11.982246 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1624ca98-e0b2-4360-81dc-778e1b928c04 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:12.106847 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-1624ca98-e0b2-4360-81dc-778e1b928c04 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:12.114840 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-1624ca98-e0b2-4360-81dc-778e1b928c04 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317" status: 200 len: 1734 microversion: 2.1 time: 0.146722 Sep 16 01:59:12.115395 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 296/577] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:59:11 2022] GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317 => generated 1734 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:59:12.458788 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-7106bfae-e6b9-4f28-b3c9-3826520d38dc tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:12.459426 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-7106bfae-e6b9-4f28-b3c9-3826520d38dc tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:12.465695 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7106bfae-e6b9-4f28-b3c9-3826520d38dc tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:12.466169 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7106bfae-e6b9-4f28-b3c9-3826520d38dc tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:12.466600 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7106bfae-e6b9-4f28-b3c9-3826520d38dc tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:12.467273 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7106bfae-e6b9-4f28-b3c9-3826520d38dc tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:12.467723 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7106bfae-e6b9-4f28-b3c9-3826520d38dc tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:12.468297 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7106bfae-e6b9-4f28-b3c9-3826520d38dc tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:12.596149 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-7106bfae-e6b9-4f28-b3c9-3826520d38dc tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:12.604078 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-7106bfae-e6b9-4f28-b3c9-3826520d38dc tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1678 microversion: 2.1 time: 0.149086 Sep 16 01:59:12.604642 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 282/578] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:59:12 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1678 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:59:13.137795 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-1c0877f7-e4d8-4832-b6fa-653d49b2e3aa tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:13.138450 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-1c0877f7-e4d8-4832-b6fa-653d49b2e3aa tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 40664bec-019b-4246-ad2b-3badd9b2e317] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:13.145021 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1c0877f7-e4d8-4832-b6fa-653d49b2e3aa tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:13.145497 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1c0877f7-e4d8-4832-b6fa-653d49b2e3aa tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:13.145926 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1c0877f7-e4d8-4832-b6fa-653d49b2e3aa tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:13.146595 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1c0877f7-e4d8-4832-b6fa-653d49b2e3aa tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:13.147037 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1c0877f7-e4d8-4832-b6fa-653d49b2e3aa tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:13.147452 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1c0877f7-e4d8-4832-b6fa-653d49b2e3aa tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:13.282366 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-1c0877f7-e4d8-4832-b6fa-653d49b2e3aa tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:13.290531 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-1c0877f7-e4d8-4832-b6fa-653d49b2e3aa tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317" status: 200 len: 1734 microversion: 2.1 time: 0.156610 Sep 16 01:59:13.291102 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 297/579] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:59:13 2022] GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317 => generated 1734 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:59:13.626866 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-516b4778-d9e9-420a-88eb-cee08198c536 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:13.627428 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-516b4778-d9e9-420a-88eb-cee08198c536 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:13.633985 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-516b4778-d9e9-420a-88eb-cee08198c536 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:13.634468 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-516b4778-d9e9-420a-88eb-cee08198c536 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:13.634899 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-516b4778-d9e9-420a-88eb-cee08198c536 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:13.635582 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-516b4778-d9e9-420a-88eb-cee08198c536 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:13.636062 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-516b4778-d9e9-420a-88eb-cee08198c536 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:13.636486 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-516b4778-d9e9-420a-88eb-cee08198c536 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:13.767364 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-516b4778-d9e9-420a-88eb-cee08198c536 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:13.774914 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-516b4778-d9e9-420a-88eb-cee08198c536 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1678 microversion: 2.1 time: 0.152186 Sep 16 01:59:13.775477 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 283/580] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:59:13 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1678 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:59:14.314563 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-0da96adc-7167-4d4e-8b70-c7a6d91ef9cb tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:14.315086 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-0da96adc-7167-4d4e-8b70-c7a6d91ef9cb tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 40664bec-019b-4246-ad2b-3badd9b2e317] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:14.321473 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0da96adc-7167-4d4e-8b70-c7a6d91ef9cb tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:14.321957 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0da96adc-7167-4d4e-8b70-c7a6d91ef9cb tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:14.322391 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0da96adc-7167-4d4e-8b70-c7a6d91ef9cb tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:14.323080 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0da96adc-7167-4d4e-8b70-c7a6d91ef9cb tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:14.323533 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0da96adc-7167-4d4e-8b70-c7a6d91ef9cb tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:14.323977 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0da96adc-7167-4d4e-8b70-c7a6d91ef9cb tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:14.452061 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-0da96adc-7167-4d4e-8b70-c7a6d91ef9cb tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:14.460689 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-0da96adc-7167-4d4e-8b70-c7a6d91ef9cb tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317" status: 200 len: 1734 microversion: 2.1 time: 0.150061 Sep 16 01:59:14.461246 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 298/581] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:59:14 2022] GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317 => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:59:14.798587 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-e4487f77-807c-4d53-8d3e-7586a41a86c8 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:14.799204 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-e4487f77-807c-4d53-8d3e-7586a41a86c8 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:14.806571 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e4487f77-807c-4d53-8d3e-7586a41a86c8 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:14.807059 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e4487f77-807c-4d53-8d3e-7586a41a86c8 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:14.807500 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e4487f77-807c-4d53-8d3e-7586a41a86c8 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:14.808209 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e4487f77-807c-4d53-8d3e-7586a41a86c8 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:14.808660 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e4487f77-807c-4d53-8d3e-7586a41a86c8 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:14.809078 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e4487f77-807c-4d53-8d3e-7586a41a86c8 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:14.938532 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-e4487f77-807c-4d53-8d3e-7586a41a86c8 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:14.946164 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-e4487f77-807c-4d53-8d3e-7586a41a86c8 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1678 microversion: 2.1 time: 0.152181 Sep 16 01:59:14.946724 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 284/582] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:59:14 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:59:15.484898 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-4ff8b586-4d55-4a6d-bb4c-44842f85be94 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:15.485503 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-4ff8b586-4d55-4a6d-bb4c-44842f85be94 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 40664bec-019b-4246-ad2b-3badd9b2e317] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:15.487513 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 01:59:15.487646 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Fri Sep 16 01:59:15 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317 (ip 10.222.0.42) !!! Sep 16 01:59:15.494144 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4ff8b586-4d55-4a6d-bb4c-44842f85be94 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:15.494619 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4ff8b586-4d55-4a6d-bb4c-44842f85be94 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:15.495048 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4ff8b586-4d55-4a6d-bb4c-44842f85be94 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:15.495729 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4ff8b586-4d55-4a6d-bb4c-44842f85be94 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:15.496202 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4ff8b586-4d55-4a6d-bb4c-44842f85be94 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:15.496619 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4ff8b586-4d55-4a6d-bb4c-44842f85be94 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:15.517105 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=3 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:15.630747 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-4ff8b586-4d55-4a6d-bb4c-44842f85be94 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:15.638876 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-4ff8b586-4d55-4a6d-bb4c-44842f85be94 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317" status: 200 len: 1734 microversion: 2.1 time: 0.158120 Sep 16 01:59:15.639430 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 299/583] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:59:15 2022] GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317 => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:59:15.968228 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-90577f89-3769-4be0-9dec-09291d1c23e1 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:15.969465 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-90577f89-3769-4be0-9dec-09291d1c23e1 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:15.976117 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-90577f89-3769-4be0-9dec-09291d1c23e1 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:15.976556 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-90577f89-3769-4be0-9dec-09291d1c23e1 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:15.977027 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-90577f89-3769-4be0-9dec-09291d1c23e1 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:15.977715 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-90577f89-3769-4be0-9dec-09291d1c23e1 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:15.978164 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-90577f89-3769-4be0-9dec-09291d1c23e1 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:15.978629 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-90577f89-3769-4be0-9dec-09291d1c23e1 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:16.109559 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-90577f89-3769-4be0-9dec-09291d1c23e1 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:16.117117 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-90577f89-3769-4be0-9dec-09291d1c23e1 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1678 microversion: 2.1 time: 0.152966 Sep 16 01:59:16.117676 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 285/584] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:59:15 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1678 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:59:16.662351 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-1ac3886b-783c-4c45-8399-0dc19abcd9b2 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:16.663005 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-1ac3886b-783c-4c45-8399-0dc19abcd9b2 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 40664bec-019b-4246-ad2b-3badd9b2e317] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:16.669299 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1ac3886b-783c-4c45-8399-0dc19abcd9b2 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:16.669779 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1ac3886b-783c-4c45-8399-0dc19abcd9b2 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:16.670212 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1ac3886b-783c-4c45-8399-0dc19abcd9b2 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:16.671436 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1ac3886b-783c-4c45-8399-0dc19abcd9b2 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:16.672075 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1ac3886b-783c-4c45-8399-0dc19abcd9b2 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:16.672499 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1ac3886b-783c-4c45-8399-0dc19abcd9b2 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:16.801222 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-1ac3886b-783c-4c45-8399-0dc19abcd9b2 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:16.809634 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-1ac3886b-783c-4c45-8399-0dc19abcd9b2 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317" status: 200 len: 1734 microversion: 2.1 time: 0.151073 Sep 16 01:59:16.810201 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 300/585] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:59:16 2022] GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317 => generated 1734 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:59:17.140175 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-bea3f457-860d-4145-a3c9-decf91181b56 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:17.141057 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-bea3f457-860d-4145-a3c9-decf91181b56 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:17.147301 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bea3f457-860d-4145-a3c9-decf91181b56 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:17.147775 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bea3f457-860d-4145-a3c9-decf91181b56 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:17.148233 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bea3f457-860d-4145-a3c9-decf91181b56 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:17.148909 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bea3f457-860d-4145-a3c9-decf91181b56 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:17.149355 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bea3f457-860d-4145-a3c9-decf91181b56 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:17.149772 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bea3f457-860d-4145-a3c9-decf91181b56 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:17.169058 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:17.288427 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-bea3f457-860d-4145-a3c9-decf91181b56 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:17.296086 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-bea3f457-860d-4145-a3c9-decf91181b56 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1655 microversion: 2.1 time: 0.160180 Sep 16 01:59:17.296646 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 286/586] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:59:17 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1655 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:59:17.318187 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-63cb5147-4aaa-450f-8622-bfedb34c6730 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:59:17.323965 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-63cb5147-4aaa-450f-8622-bfedb34c6730 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:17.324441 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-63cb5147-4aaa-450f-8622-bfedb34c6730 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:17.324863 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-63cb5147-4aaa-450f-8622-bfedb34c6730 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:17.347300 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-63cb5147-4aaa-450f-8622-bfedb34c6730 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Going to try to start instance {{(pid=120441) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 16 01:59:17.386751 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-63cb5147-4aaa-450f-8622-bfedb34c6730 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "POST /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763/action" status: 202 len: 0 microversion: 2.1 time: 0.072269 Sep 16 01:59:17.387338 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 301/587] 10.222.0.42 () {60 vars in 1278 bytes} [Fri Sep 16 01:59:17 2022] POST /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763/action => generated 0 bytes in 74 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 01:59:17.396458 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-78324eb6-18be-4dcb-8804-1b08a4f9d0d4 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:17.397126 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-78324eb6-18be-4dcb-8804-1b08a4f9d0d4 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:17.402929 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-78324eb6-18be-4dcb-8804-1b08a4f9d0d4 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:17.403406 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-78324eb6-18be-4dcb-8804-1b08a4f9d0d4 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:17.403830 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-78324eb6-18be-4dcb-8804-1b08a4f9d0d4 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:17.404545 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-78324eb6-18be-4dcb-8804-1b08a4f9d0d4 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:17.405098 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-78324eb6-18be-4dcb-8804-1b08a4f9d0d4 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:17.405953 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-78324eb6-18be-4dcb-8804-1b08a4f9d0d4 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:17.541166 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-78324eb6-18be-4dcb-8804-1b08a4f9d0d4 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:17.549282 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-78324eb6-18be-4dcb-8804-1b08a4f9d0d4 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1664 microversion: 2.1 time: 0.156774 Sep 16 01:59:17.549869 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 287/588] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:59:17 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1664 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:59:17.834116 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-6ed33147-25af-4431-9058-11311b96dcea tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:17.834908 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-6ed33147-25af-4431-9058-11311b96dcea tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 40664bec-019b-4246-ad2b-3badd9b2e317] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:17.841468 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-6ed33147-25af-4431-9058-11311b96dcea tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:17.842028 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-6ed33147-25af-4431-9058-11311b96dcea tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:17.842466 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-6ed33147-25af-4431-9058-11311b96dcea tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:17.843322 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-6ed33147-25af-4431-9058-11311b96dcea tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:17.843775 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-6ed33147-25af-4431-9058-11311b96dcea tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:17.844241 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-6ed33147-25af-4431-9058-11311b96dcea tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:18.072175 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-6ed33147-25af-4431-9058-11311b96dcea tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:18.080337 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-6ed33147-25af-4431-9058-11311b96dcea tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317" status: 200 len: 1734 microversion: 2.1 time: 0.250449 Sep 16 01:59:18.080901 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 302/589] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:59:17 2022] GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317 => generated 1734 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:59:18.572599 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-eb2ee221-c64e-4108-a5ab-4d4058485fec tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:18.573207 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-eb2ee221-c64e-4108-a5ab-4d4058485fec tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:18.580096 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-eb2ee221-c64e-4108-a5ab-4d4058485fec tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:18.580585 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-eb2ee221-c64e-4108-a5ab-4d4058485fec tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:18.581022 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-eb2ee221-c64e-4108-a5ab-4d4058485fec tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:18.581702 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-eb2ee221-c64e-4108-a5ab-4d4058485fec tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:18.582157 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-eb2ee221-c64e-4108-a5ab-4d4058485fec tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:18.582576 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-eb2ee221-c64e-4108-a5ab-4d4058485fec tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:18.713052 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-eb2ee221-c64e-4108-a5ab-4d4058485fec tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:18.722226 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-eb2ee221-c64e-4108-a5ab-4d4058485fec tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1664 microversion: 2.1 time: 0.153497 Sep 16 01:59:18.722796 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 288/590] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:59:18 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1664 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:59:19.104316 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-36c67d12-3997-45bc-96b7-9be9e78d9259 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:19.104927 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-36c67d12-3997-45bc-96b7-9be9e78d9259 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 40664bec-019b-4246-ad2b-3badd9b2e317] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:19.111833 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-36c67d12-3997-45bc-96b7-9be9e78d9259 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:19.112344 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-36c67d12-3997-45bc-96b7-9be9e78d9259 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:19.112779 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-36c67d12-3997-45bc-96b7-9be9e78d9259 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:19.113453 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-36c67d12-3997-45bc-96b7-9be9e78d9259 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:19.113910 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-36c67d12-3997-45bc-96b7-9be9e78d9259 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:19.114357 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-36c67d12-3997-45bc-96b7-9be9e78d9259 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:19.246408 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-36c67d12-3997-45bc-96b7-9be9e78d9259 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:19.255116 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-36c67d12-3997-45bc-96b7-9be9e78d9259 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317" status: 200 len: 1734 microversion: 2.1 time: 0.154755 Sep 16 01:59:19.255714 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 303/591] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:59:19 2022] GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317 => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:59:19.744421 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-dbfb2701-885c-4550-bcf9-a42106fe8d1c tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:19.745075 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-dbfb2701-885c-4550-bcf9-a42106fe8d1c tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:19.752079 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-dbfb2701-885c-4550-bcf9-a42106fe8d1c tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:19.752514 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-dbfb2701-885c-4550-bcf9-a42106fe8d1c tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:19.753207 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-dbfb2701-885c-4550-bcf9-a42106fe8d1c tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:19.753897 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-dbfb2701-885c-4550-bcf9-a42106fe8d1c tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:19.754351 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-dbfb2701-885c-4550-bcf9-a42106fe8d1c tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:19.754779 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-dbfb2701-885c-4550-bcf9-a42106fe8d1c tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:19.887678 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-dbfb2701-885c-4550-bcf9-a42106fe8d1c tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:19.896056 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-dbfb2701-885c-4550-bcf9-a42106fe8d1c tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1668 microversion: 2.1 time: 0.155488 Sep 16 01:59:19.896616 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 289/592] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:59:19 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1668 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:59:20.278588 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-47ec78b5-80e0-460b-a7ed-a53da2c2b763 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:20.279231 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-47ec78b5-80e0-460b-a7ed-a53da2c2b763 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 40664bec-019b-4246-ad2b-3badd9b2e317] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:20.286246 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-47ec78b5-80e0-460b-a7ed-a53da2c2b763 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:20.286729 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-47ec78b5-80e0-460b-a7ed-a53da2c2b763 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:20.287169 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-47ec78b5-80e0-460b-a7ed-a53da2c2b763 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:20.287857 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-47ec78b5-80e0-460b-a7ed-a53da2c2b763 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:20.288412 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-47ec78b5-80e0-460b-a7ed-a53da2c2b763 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:20.288842 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-47ec78b5-80e0-460b-a7ed-a53da2c2b763 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:20.413984 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-47ec78b5-80e0-460b-a7ed-a53da2c2b763 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:20.422153 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-47ec78b5-80e0-460b-a7ed-a53da2c2b763 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317" status: 200 len: 1734 microversion: 2.1 time: 0.147488 Sep 16 01:59:20.422714 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 304/593] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:59:20 2022] GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317 => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:59:21.445152 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-c325317f-93b1-49a7-95be-57c71eeacd0a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:21.445764 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-c325317f-93b1-49a7-95be-57c71eeacd0a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 40664bec-019b-4246-ad2b-3badd9b2e317] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:21.452934 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c325317f-93b1-49a7-95be-57c71eeacd0a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:21.453458 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c325317f-93b1-49a7-95be-57c71eeacd0a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:21.453890 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c325317f-93b1-49a7-95be-57c71eeacd0a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:21.454574 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c325317f-93b1-49a7-95be-57c71eeacd0a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:21.455028 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c325317f-93b1-49a7-95be-57c71eeacd0a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:21.455456 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c325317f-93b1-49a7-95be-57c71eeacd0a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:21.585771 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-c325317f-93b1-49a7-95be-57c71eeacd0a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:21.594239 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-c325317f-93b1-49a7-95be-57c71eeacd0a tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317" status: 200 len: 1734 microversion: 2.1 time: 0.152953 Sep 16 01:59:21.594804 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 290/594] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:59:21 2022] GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317 => generated 1734 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:59:22.618450 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-e877203e-2d1d-4bb1-8010-d668c486a933 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:22.619043 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-e877203e-2d1d-4bb1-8010-d668c486a933 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 40664bec-019b-4246-ad2b-3badd9b2e317] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:22.621237 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_api:SELECT=39 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:22.626742 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e877203e-2d1d-4bb1-8010-d668c486a933 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:22.627223 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e877203e-2d1d-4bb1-8010-d668c486a933 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:22.627920 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e877203e-2d1d-4bb1-8010-d668c486a933 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:22.628625 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e877203e-2d1d-4bb1-8010-d668c486a933 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:22.629079 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e877203e-2d1d-4bb1-8010-d668c486a933 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:22.629503 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e877203e-2d1d-4bb1-8010-d668c486a933 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:22.757892 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-e877203e-2d1d-4bb1-8010-d668c486a933 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:22.766551 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-e877203e-2d1d-4bb1-8010-d668c486a933 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317" status: 200 len: 1734 microversion: 2.1 time: 0.151991 Sep 16 01:59:22.767123 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 305/595] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:59:22 2022] GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317 => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:59:23.789906 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-ba74fc68-e050-4cc7-ad65-02d888c4b6ef tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:23.790503 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-ba74fc68-e050-4cc7-ad65-02d888c4b6ef tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 40664bec-019b-4246-ad2b-3badd9b2e317] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:23.797895 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ba74fc68-e050-4cc7-ad65-02d888c4b6ef tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:23.798376 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ba74fc68-e050-4cc7-ad65-02d888c4b6ef tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:23.798807 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ba74fc68-e050-4cc7-ad65-02d888c4b6ef tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:23.799491 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ba74fc68-e050-4cc7-ad65-02d888c4b6ef tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:23.799963 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ba74fc68-e050-4cc7-ad65-02d888c4b6ef tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:23.800406 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ba74fc68-e050-4cc7-ad65-02d888c4b6ef tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:23.927123 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-ba74fc68-e050-4cc7-ad65-02d888c4b6ef tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:23.935126 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-ba74fc68-e050-4cc7-ad65-02d888c4b6ef tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317" status: 200 len: 1734 microversion: 2.1 time: 0.149145 Sep 16 01:59:23.935680 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 291/596] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:59:23 2022] GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317 => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:59:24.957313 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-d593493c-2a51-4a85-8585-d74fcb7d21d4 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:24.957919 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-d593493c-2a51-4a85-8585-d74fcb7d21d4 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 40664bec-019b-4246-ad2b-3badd9b2e317] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:24.964958 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d593493c-2a51-4a85-8585-d74fcb7d21d4 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:24.965220 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d593493c-2a51-4a85-8585-d74fcb7d21d4 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:24.965653 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d593493c-2a51-4a85-8585-d74fcb7d21d4 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:24.966342 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d593493c-2a51-4a85-8585-d74fcb7d21d4 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:24.967077 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d593493c-2a51-4a85-8585-d74fcb7d21d4 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:24.967214 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d593493c-2a51-4a85-8585-d74fcb7d21d4 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:25.098849 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-d593493c-2a51-4a85-8585-d74fcb7d21d4 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:25.106946 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-d593493c-2a51-4a85-8585-d74fcb7d21d4 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317" status: 200 len: 1714 microversion: 2.1 time: 0.153475 Sep 16 01:59:25.107504 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 306/597] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:59:24 2022] GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317 => generated 1714 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:59:25.168803 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-d97897dd-6667-4cf5-a8e6-8d2d38fbf815 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:25.169297 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-d97897dd-6667-4cf5-a8e6-8d2d38fbf815 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 40664bec-019b-4246-ad2b-3badd9b2e317] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:25.176494 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d97897dd-6667-4cf5-a8e6-8d2d38fbf815 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:25.176970 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d97897dd-6667-4cf5-a8e6-8d2d38fbf815 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:25.177400 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d97897dd-6667-4cf5-a8e6-8d2d38fbf815 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:25.178073 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d97897dd-6667-4cf5-a8e6-8d2d38fbf815 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:25.178523 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d97897dd-6667-4cf5-a8e6-8d2d38fbf815 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:25.178942 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d97897dd-6667-4cf5-a8e6-8d2d38fbf815 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:25.303687 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.wsgi [None req-d97897dd-6667-4cf5-a8e6-8d2d38fbf815 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] HTTP exception thrown: Cannot 'detach_volume' instance 40664bec-019b-4246-ad2b-3badd9b2e317 while it is in vm_state rescued Sep 16 01:59:25.305269 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-d97897dd-6667-4cf5-a8e6-8d2d38fbf815 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Request method failure captured: Sep 16 01:59:25.305269 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: request: DELETE /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317/os-volume_attachments/4b52ad91-2825-48c4-b8f0-8c04ada51edb HTTP/1.1 Sep 16 01:59:25.305269 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept: application/json Sep 16 01:59:25.305269 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept-Encoding: identity Sep 16 01:59:25.305269 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Connection: close Sep 16 01:59:25.305269 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Length: 0 Sep 16 01:59:25.305269 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Type: application/json Sep 16 01:59:25.305269 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Host: 10.222.0.42 Sep 16 01:59:25.305269 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Openstack-System-Scope: None Sep 16 01:59:25.305269 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: User-Agent: python-urllib3/1.26.12 Sep 16 01:59:25.305269 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Auth-Token: gAAAAABjI9c-Il8-3hF9Li-IW6ki3rCRxsddmEYj-CEjGwEumw94mpgkrl63sWplgEqXoUz3fiC-3x44O1RRD4kaA9W4JY76zYcpF4adB0c8IXHbjAFOjhvg_wlD1HQTgu9jYX9bvxA4OlQVlK-DbI0GW9oqAmi3IZAroqSCl3VtQWlC8iqMZFo Sep 16 01:59:25.305269 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Id: None Sep 16 01:59:25.305269 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Name: None Sep 16 01:59:25.305269 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Identity-Status: Confirmed Sep 16 01:59:25.305269 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Is-Admin-Project: True Sep 16 01:59:25.305269 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Id: default Sep 16 01:59:25.305269 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Name: Default Sep 16 01:59:25.305269 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Id: 57aaf234892543698d91303961f14abd Sep 16 01:59:25.305269 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1497504670 Sep 16 01:59:25.305269 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Role: member,reader Sep 16 01:59:25.305269 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Roles: member,reader Sep 16 01:59:25.306888 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/57aaf234892543698d91303961f14abd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/57aaf234892543698d91303961f14abd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_57aaf234892543698d91303961f14abd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/57aaf234892543698d91303961f14abd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 01:59:25.306888 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1497504670 Sep 16 01:59:25.306888 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Id: 57aaf234892543698d91303961f14abd Sep 16 01:59:25.306888 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1497504670 Sep 16 01:59:25.306888 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User: tempest-ServerRescueNegativeTestJSON-1497504670-project Sep 16 01:59:25.306888 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Id: default Sep 16 01:59:25.306888 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Name: Default Sep 16 01:59:25.306888 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Id: 7eb6ab0644bf4fa59d7bba232d6ccb3c Sep 16 01:59:25.306888 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1497504670-project Sep 16 01:59:25.306888 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: method: > Sep 16 01:59:25.306888 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: exception: Cannot 'detach_volume' instance 40664bec-019b-4246-ad2b-3badd9b2e317 while it is in vm_state rescued Sep 16 01:59:25.307762 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: action_args: {'server_id': '40664bec-019b-4246-ad2b-3badd9b2e317', 'id': '4b52ad91-2825-48c4-b8f0-8c04ada51edb'} Sep 16 01:59:25.307762 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 01:59:25.307762 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:59:25.307762 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 16 01:59:25.307762 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 16 01:59:25.307762 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 16 01:59:25.307762 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 16 01:59:25.307762 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 16 01:59:25.307762 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 16 01:59:25.307762 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 40664bec-019b-4246-ad2b-3badd9b2e317 in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 16 01:59:25.307762 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 01:59:25.307762 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:59:25.307762 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 01:59:25.307762 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:59:25.307762 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 01:59:25.307762 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 01:59:25.307762 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 01:59:25.307762 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 01:59:25.307762 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 01:59:25.307762 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 01:59:25.309309 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 16 01:59:25.309309 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 16 01:59:25.309309 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 16 01:59:25.309309 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 16 01:59:25.309309 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 40664bec-019b-4246-ad2b-3badd9b2e317 while it is in vm_state rescued Sep 16 01:59:25.309309 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 01:59:25.309309 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:59:25.309309 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 01:59:25.309309 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:59:25.309309 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 01:59:25.309309 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 01:59:25.309309 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 01:59:25.309309 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 01:59:25.309309 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 40664bec-019b-4246-ad2b-3badd9b2e317 while it is in vm_state rescued Sep 16 01:59:25.309309 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 01:59:25.309309 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-d97897dd-6667-4cf5-a8e6-8d2d38fbf815 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Returning 409 to user: Cannot 'detach_volume' instance 40664bec-019b-4246-ad2b-3badd9b2e317 while it is in vm_state rescued {{(pid=120440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 01:59:25.310679 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-d97897dd-6667-4cf5-a8e6-8d2d38fbf815 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "DELETE /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317/os-volume_attachments/4b52ad91-2825-48c4-b8f0-8c04ada51edb" status: 409 len: 152 microversion: 2.1 time: 0.141791 Sep 16 01:59:25.310679 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 292/598] 10.222.0.42 () {58 vars in 1416 bytes} [Fri Sep 16 01:59:25 2022] DELETE /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317/os-volume_attachments/4b52ad91-2825-48c4-b8f0-8c04ada51edb => generated 152 bytes in 143 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 16 01:59:25.315561 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-3e824e54-8738-460a-b5b1-68072a381a49 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:59:25.316136 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-3e824e54-8738-460a-b5b1-68072a381a49 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 40664bec-019b-4246-ad2b-3badd9b2e317] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:25.321887 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3e824e54-8738-460a-b5b1-68072a381a49 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:25.322366 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3e824e54-8738-460a-b5b1-68072a381a49 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:25.322801 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3e824e54-8738-460a-b5b1-68072a381a49 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:25.323485 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3e824e54-8738-460a-b5b1-68072a381a49 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:25.324003 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3e824e54-8738-460a-b5b1-68072a381a49 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:25.324425 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3e824e54-8738-460a-b5b1-68072a381a49 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:25.392914 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-3e824e54-8738-460a-b5b1-68072a381a49 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "POST /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317/action" status: 202 len: 0 microversion: 2.1 time: 0.081000 Sep 16 01:59:25.393752 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 307/599] 10.222.0.42 () {60 vars in 1278 bytes} [Fri Sep 16 01:59:25 2022] POST /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317/action => generated 0 bytes in 82 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 01:59:25.402718 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-364fca47-c7e1-4532-bce1-a538ec2b9049 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:25.403333 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-364fca47-c7e1-4532-bce1-a538ec2b9049 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 40664bec-019b-4246-ad2b-3badd9b2e317] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:25.410053 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-364fca47-c7e1-4532-bce1-a538ec2b9049 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:25.410559 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-364fca47-c7e1-4532-bce1-a538ec2b9049 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:25.410977 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-364fca47-c7e1-4532-bce1-a538ec2b9049 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:25.411670 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-364fca47-c7e1-4532-bce1-a538ec2b9049 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:25.412150 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-364fca47-c7e1-4532-bce1-a538ec2b9049 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:25.412576 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-364fca47-c7e1-4532-bce1-a538ec2b9049 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:25.543615 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-364fca47-c7e1-4532-bce1-a538ec2b9049 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:25.552186 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-364fca47-c7e1-4532-bce1-a538ec2b9049 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317" status: 200 len: 1722 microversion: 2.1 time: 0.154202 Sep 16 01:59:25.552845 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 293/600] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:59:25 2022] GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317 => generated 1722 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:59:26.577491 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-e47dff37-599d-4457-8785-af863a07f729 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:26.578182 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-e47dff37-599d-4457-8785-af863a07f729 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 40664bec-019b-4246-ad2b-3badd9b2e317] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:26.584322 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e47dff37-599d-4457-8785-af863a07f729 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:26.584806 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e47dff37-599d-4457-8785-af863a07f729 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:26.585245 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e47dff37-599d-4457-8785-af863a07f729 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:26.585924 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e47dff37-599d-4457-8785-af863a07f729 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:26.586376 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e47dff37-599d-4457-8785-af863a07f729 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:26.586800 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e47dff37-599d-4457-8785-af863a07f729 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:26.717011 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-e47dff37-599d-4457-8785-af863a07f729 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:26.725177 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-e47dff37-599d-4457-8785-af863a07f729 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317" status: 200 len: 1722 microversion: 2.1 time: 0.153100 Sep 16 01:59:26.725737 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 308/601] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:59:26 2022] GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317 => generated 1722 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:59:27.749290 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-f6a4d16b-737a-4cb4-b17c-015dddf812a0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:27.750048 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-f6a4d16b-737a-4cb4-b17c-015dddf812a0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 40664bec-019b-4246-ad2b-3badd9b2e317] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:27.757858 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f6a4d16b-737a-4cb4-b17c-015dddf812a0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:27.758407 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f6a4d16b-737a-4cb4-b17c-015dddf812a0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:27.758939 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f6a4d16b-737a-4cb4-b17c-015dddf812a0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:27.759913 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f6a4d16b-737a-4cb4-b17c-015dddf812a0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:27.760545 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f6a4d16b-737a-4cb4-b17c-015dddf812a0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:27.761204 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f6a4d16b-737a-4cb4-b17c-015dddf812a0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:27.902311 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-f6a4d16b-737a-4cb4-b17c-015dddf812a0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:27.912201 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-f6a4d16b-737a-4cb4-b17c-015dddf812a0 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317" status: 200 len: 1722 microversion: 2.1 time: 0.167093 Sep 16 01:59:27.912782 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 294/602] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:59:27 2022] GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317 => generated 1722 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:59:28.935429 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-79c37839-66f2-4a9a-b9cb-87cdb6d3a1ac tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:28.936644 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-79c37839-66f2-4a9a-b9cb-87cdb6d3a1ac tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 40664bec-019b-4246-ad2b-3badd9b2e317] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:28.942935 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-79c37839-66f2-4a9a-b9cb-87cdb6d3a1ac tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:28.943415 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-79c37839-66f2-4a9a-b9cb-87cdb6d3a1ac tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:28.943843 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-79c37839-66f2-4a9a-b9cb-87cdb6d3a1ac tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:28.944554 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-79c37839-66f2-4a9a-b9cb-87cdb6d3a1ac tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:28.945005 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-79c37839-66f2-4a9a-b9cb-87cdb6d3a1ac tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:28.945423 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-79c37839-66f2-4a9a-b9cb-87cdb6d3a1ac tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:29.076356 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-79c37839-66f2-4a9a-b9cb-87cdb6d3a1ac tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:29.084629 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-79c37839-66f2-4a9a-b9cb-87cdb6d3a1ac tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317" status: 200 len: 1728 microversion: 2.1 time: 0.153054 Sep 16 01:59:29.085192 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 309/603] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 01:59:28 2022] GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317 => generated 1728 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:59:29.112247 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-07b9be1f-10c4-4387-a39c-ee16dea14bc9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:29.112775 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-07b9be1f-10c4-4387-a39c-ee16dea14bc9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 40664bec-019b-4246-ad2b-3badd9b2e317] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:29.119315 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-07b9be1f-10c4-4387-a39c-ee16dea14bc9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:29.119831 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-07b9be1f-10c4-4387-a39c-ee16dea14bc9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:29.120948 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-07b9be1f-10c4-4387-a39c-ee16dea14bc9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:29.121652 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-07b9be1f-10c4-4387-a39c-ee16dea14bc9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:29.122125 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-07b9be1f-10c4-4387-a39c-ee16dea14bc9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:29.122557 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-07b9be1f-10c4-4387-a39c-ee16dea14bc9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:29.202190 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-07b9be1f-10c4-4387-a39c-ee16dea14bc9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093734 Sep 16 01:59:29.202783 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 295/604] 10.222.0.42 () {58 vars in 1275 bytes} [Fri Sep 16 01:59:29 2022] GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:59:30.384991 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [req-be79c814-a1ed-4b98-9930-bce49cce9350 req-7c56a506-07ef-44b8-b00b-4d09da66f57f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40664bec-019b-4246-ad2b-3badd9b2e317", "tag": "1f6c616e-c78b-414c-883d-8d50a28be1bc"}]} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:59:30.394918 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-be79c814-a1ed-4b98-9930-bce49cce9350 req-7c56a506-07ef-44b8-b00b-4d09da66f57f service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:30.395401 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-be79c814-a1ed-4b98-9930-bce49cce9350 req-7c56a506-07ef-44b8-b00b-4d09da66f57f service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:30.395832 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-be79c814-a1ed-4b98-9930-bce49cce9350 req-7c56a506-07ef-44b8-b00b-4d09da66f57f service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:30.406984 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.compute.server_external_events [req-be79c814-a1ed-4b98-9930-bce49cce9350 req-7c56a506-07ef-44b8-b00b-4d09da66f57f service nova] Creating event network-changed:1f6c616e-c78b-414c-883d-8d50a28be1bc for instance 40664bec-019b-4246-ad2b-3badd9b2e317 on hv-cinder-84914 Sep 16 01:59:30.411884 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [req-be79c814-a1ed-4b98-9930-bce49cce9350 req-7c56a506-07ef-44b8-b00b-4d09da66f57f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.089518 Sep 16 01:59:30.412802 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 310/605] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 01:59:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 01:59:32.430315 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [req-d81c73bd-b026-40c7-a260-c32dc7ce6b21 req-f38a629d-b8a9-459a-8193-ca98388eba16 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "40664bec-019b-4246-ad2b-3badd9b2e317", "tag": "1f6c616e-c78b-414c-883d-8d50a28be1bc"}]} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:59:32.435275 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_api:SELECT=49 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:32.441524 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-d81c73bd-b026-40c7-a260-c32dc7ce6b21 req-f38a629d-b8a9-459a-8193-ca98388eba16 service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:32.442005 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-d81c73bd-b026-40c7-a260-c32dc7ce6b21 req-f38a629d-b8a9-459a-8193-ca98388eba16 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:32.442441 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-d81c73bd-b026-40c7-a260-c32dc7ce6b21 req-f38a629d-b8a9-459a-8193-ca98388eba16 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:32.453332 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.compute.server_external_events [req-d81c73bd-b026-40c7-a260-c32dc7ce6b21 req-f38a629d-b8a9-459a-8193-ca98388eba16 service nova] Creating event network-changed:1f6c616e-c78b-414c-883d-8d50a28be1bc for instance 40664bec-019b-4246-ad2b-3badd9b2e317 on hv-cinder-84914 Sep 16 01:59:32.458247 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [req-d81c73bd-b026-40c7-a260-c32dc7ce6b21 req-f38a629d-b8a9-459a-8193-ca98388eba16 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032482 Sep 16 01:59:32.458823 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 296/606] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 01:59:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:59:39.070948 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-52588d79-fbee-4ab1-b48c-e3b90b1c6943 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:39.071633 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-52588d79-fbee-4ab1-b48c-e3b90b1c6943 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:39.078180 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-52588d79-fbee-4ab1-b48c-e3b90b1c6943 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:39.078658 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-52588d79-fbee-4ab1-b48c-e3b90b1c6943 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:39.079086 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-52588d79-fbee-4ab1-b48c-e3b90b1c6943 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:39.079764 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-52588d79-fbee-4ab1-b48c-e3b90b1c6943 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:39.080242 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-52588d79-fbee-4ab1-b48c-e3b90b1c6943 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:39.080664 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-52588d79-fbee-4ab1-b48c-e3b90b1c6943 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:39.112542 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-52588d79-fbee-4ab1-b48c-e3b90b1c6943 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6/os-volume_attachments/5718da94-48fe-4cff-a6ba-0f4044bf3c89" status: 200 len: 194 microversion: 2.20 time: 0.150252 Sep 16 01:59:39.113108 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 311/607] 10.222.0.42 () {60 vars in 1454 bytes} [Fri Sep 16 01:59:38 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6/os-volume_attachments/5718da94-48fe-4cff-a6ba-0f4044bf3c89 => generated 194 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 01:59:39.183480 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-c4c4bae6-b71b-4c7c-b995-f3ba59e08ec9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:39.184102 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-c4c4bae6-b71b-4c7c-b995-f3ba59e08ec9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:39.190823 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c4c4bae6-b71b-4c7c-b995-f3ba59e08ec9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:39.191317 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c4c4bae6-b71b-4c7c-b995-f3ba59e08ec9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:39.191759 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c4c4bae6-b71b-4c7c-b995-f3ba59e08ec9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:39.192520 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c4c4bae6-b71b-4c7c-b995-f3ba59e08ec9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:39.192943 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c4c4bae6-b71b-4c7c-b995-f3ba59e08ec9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:39.193364 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c4c4bae6-b71b-4c7c-b995-f3ba59e08ec9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:39.274881 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.objects.instance [None req-c4c4bae6-b71b-4c7c-b995-f3ba59e08ec9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lazy-loading 'services' on Instance uuid 3e390b45-0b39-4429-9431-7ee6af3806e6 {{(pid=120440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 01:59:39.391096 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-c4c4bae6-b71b-4c7c-b995-f3ba59e08ec9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6/os-volume_attachments/5718da94-48fe-4cff-a6ba-0f4044bf3c89" status: 202 len: 0 microversion: 2.20 time: 0.212305 Sep 16 01:59:39.391684 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 297/608] 10.222.0.42 () {60 vars in 1457 bytes} [Fri Sep 16 01:59:39 2022] DELETE /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6/os-volume_attachments/5718da94-48fe-4cff-a6ba-0f4044bf3c89 => generated 0 bytes in 214 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 16 01:59:39.400110 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-dfa6d838-96a8-436f-83e3-5215b7018a08 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:39.402236 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-dfa6d838-96a8-436f-83e3-5215b7018a08 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:39.408890 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-dfa6d838-96a8-436f-83e3-5215b7018a08 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:39.409383 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-dfa6d838-96a8-436f-83e3-5215b7018a08 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:39.409845 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-dfa6d838-96a8-436f-83e3-5215b7018a08 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:39.410518 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-dfa6d838-96a8-436f-83e3-5215b7018a08 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:39.410961 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-dfa6d838-96a8-436f-83e3-5215b7018a08 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:39.411381 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-dfa6d838-96a8-436f-83e3-5215b7018a08 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:39.441410 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-dfa6d838-96a8-436f-83e3-5215b7018a08 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045166 Sep 16 01:59:39.442020 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 312/609] 10.222.0.42 () {60 vars in 1343 bytes} [Fri Sep 16 01:59:39 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 01:59:40.455819 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-51d757c3-c89f-430f-856a-45c82e987ea3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:40.458145 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-51d757c3-c89f-430f-856a-45c82e987ea3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:40.464350 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-51d757c3-c89f-430f-856a-45c82e987ea3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:40.464833 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-51d757c3-c89f-430f-856a-45c82e987ea3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:40.465268 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-51d757c3-c89f-430f-856a-45c82e987ea3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:40.465962 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-51d757c3-c89f-430f-856a-45c82e987ea3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:40.466410 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-51d757c3-c89f-430f-856a-45c82e987ea3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:40.466892 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-51d757c3-c89f-430f-856a-45c82e987ea3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:40.497150 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-51d757c3-c89f-430f-856a-45c82e987ea3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046679 Sep 16 01:59:40.497718 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 298/610] 10.222.0.42 () {60 vars in 1343 bytes} [Fri Sep 16 01:59:40 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 01:59:40.567485 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-fe6c9720-0273-47d1-9757-73de36c47e72 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:40.568017 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-fe6c9720-0273-47d1-9757-73de36c47e72 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:40.575642 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fe6c9720-0273-47d1-9757-73de36c47e72 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:40.576605 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fe6c9720-0273-47d1-9757-73de36c47e72 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:40.577397 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fe6c9720-0273-47d1-9757-73de36c47e72 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:40.578625 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fe6c9720-0273-47d1-9757-73de36c47e72 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:40.579469 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fe6c9720-0273-47d1-9757-73de36c47e72 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:40.580302 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fe6c9720-0273-47d1-9757-73de36c47e72 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:40.606673 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-fe6c9720-0273-47d1-9757-73de36c47e72 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Going to try to terminate instance {{(pid=120441) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 01:59:40.645835 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:40.692899 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-fe6c9720-0273-47d1-9757-73de36c47e72 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 204 len: 0 microversion: 2.20 time: 0.128915 Sep 16 01:59:40.693554 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 313/611] 10.222.0.42 () {60 vars in 1280 bytes} [Fri Sep 16 01:59:40 2022] DELETE /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 0 bytes in 130 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 16 01:59:40.702970 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-314f49b7-3f58-42bd-a6be-41a4767c9a56 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:40.703585 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-314f49b7-3f58-42bd-a6be-41a4767c9a56 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:40.709589 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-314f49b7-3f58-42bd-a6be-41a4767c9a56 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:40.710076 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-314f49b7-3f58-42bd-a6be-41a4767c9a56 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:40.710513 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-314f49b7-3f58-42bd-a6be-41a4767c9a56 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:40.711206 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-314f49b7-3f58-42bd-a6be-41a4767c9a56 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:40.711664 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-314f49b7-3f58-42bd-a6be-41a4767c9a56 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:40.712119 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-314f49b7-3f58-42bd-a6be-41a4767c9a56 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:40.843891 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-314f49b7-3f58-42bd-a6be-41a4767c9a56 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:40.851802 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-314f49b7-3f58-42bd-a6be-41a4767c9a56 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:40.853272 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-314f49b7-3f58-42bd-a6be-41a4767c9a56 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:40.854417 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-314f49b7-3f58-42bd-a6be-41a4767c9a56 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1724 microversion: 2.20 time: 0.156126 Sep 16 01:59:40.854970 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 299/612] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:59:40 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:59:41.881079 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-07aa2d88-26a2-49cb-b5a0-b255cb85d8ef tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:41.881813 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-07aa2d88-26a2-49cb-b5a0-b255cb85d8ef tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:41.888131 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-07aa2d88-26a2-49cb-b5a0-b255cb85d8ef tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:41.888660 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-07aa2d88-26a2-49cb-b5a0-b255cb85d8ef tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:41.889101 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-07aa2d88-26a2-49cb-b5a0-b255cb85d8ef tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:41.889777 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-07aa2d88-26a2-49cb-b5a0-b255cb85d8ef tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:41.890228 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-07aa2d88-26a2-49cb-b5a0-b255cb85d8ef tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:41.890652 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-07aa2d88-26a2-49cb-b5a0-b255cb85d8ef tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:42.022431 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-07aa2d88-26a2-49cb-b5a0-b255cb85d8ef tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:42.031107 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-07aa2d88-26a2-49cb-b5a0-b255cb85d8ef tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:42.032587 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-07aa2d88-26a2-49cb-b5a0-b255cb85d8ef tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:42.033801 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-07aa2d88-26a2-49cb-b5a0-b255cb85d8ef tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1724 microversion: 2.20 time: 0.157272 Sep 16 01:59:42.034356 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 314/613] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:59:41 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:59:43.058677 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-81650757-214c-47e1-bb51-8992fa93aa8b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:43.059282 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-81650757-214c-47e1-bb51-8992fa93aa8b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:43.066236 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-81650757-214c-47e1-bb51-8992fa93aa8b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:43.066647 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-81650757-214c-47e1-bb51-8992fa93aa8b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:43.067076 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-81650757-214c-47e1-bb51-8992fa93aa8b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:43.067753 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-81650757-214c-47e1-bb51-8992fa93aa8b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:43.068233 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-81650757-214c-47e1-bb51-8992fa93aa8b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:43.068652 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-81650757-214c-47e1-bb51-8992fa93aa8b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:43.202712 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-81650757-214c-47e1-bb51-8992fa93aa8b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:43.211116 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-81650757-214c-47e1-bb51-8992fa93aa8b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:43.212717 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-81650757-214c-47e1-bb51-8992fa93aa8b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:43.213989 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-81650757-214c-47e1-bb51-8992fa93aa8b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1724 microversion: 2.20 time: 0.159194 Sep 16 01:59:43.214603 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 300/614] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:59:43 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:59:43.703899 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [req-7f2e3bc2-f071-4183-a53f-4a5cbffbfbbb req-8853570e-714b-4c97-a110-93d8e9575991 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3e390b45-0b39-4429-9431-7ee6af3806e6", "name": "network-vif-deleted", "tag": "dc91b77b-583a-4740-a244-adc53daa4347"}]} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:59:43.713533 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-7f2e3bc2-f071-4183-a53f-4a5cbffbfbbb req-8853570e-714b-4c97-a110-93d8e9575991 service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:43.714243 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-7f2e3bc2-f071-4183-a53f-4a5cbffbfbbb req-8853570e-714b-4c97-a110-93d8e9575991 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:43.714670 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-7f2e3bc2-f071-4183-a53f-4a5cbffbfbbb req-8853570e-714b-4c97-a110-93d8e9575991 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:43.726793 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.compute.server_external_events [req-7f2e3bc2-f071-4183-a53f-4a5cbffbfbbb req-8853570e-714b-4c97-a110-93d8e9575991 service nova] Creating event network-vif-deleted:dc91b77b-583a-4740-a244-adc53daa4347 for instance 3e390b45-0b39-4429-9431-7ee6af3806e6 on hv-cinder-84914 Sep 16 01:59:43.733337 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [req-7f2e3bc2-f071-4183-a53f-4a5cbffbfbbb req-8853570e-714b-4c97-a110-93d8e9575991 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033211 Sep 16 01:59:43.735199 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 315/615] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 01:59:43 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:59:44.241556 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-6783cb2c-ecb0-45f8-b0b8-ea992b2f47fe tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:44.242752 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-6783cb2c-ecb0-45f8-b0b8-ea992b2f47fe tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:44.249481 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6783cb2c-ecb0-45f8-b0b8-ea992b2f47fe tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:44.250214 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6783cb2c-ecb0-45f8-b0b8-ea992b2f47fe tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:44.250808 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6783cb2c-ecb0-45f8-b0b8-ea992b2f47fe tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:44.251670 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6783cb2c-ecb0-45f8-b0b8-ea992b2f47fe tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:44.252309 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6783cb2c-ecb0-45f8-b0b8-ea992b2f47fe tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:44.253132 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6783cb2c-ecb0-45f8-b0b8-ea992b2f47fe tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:44.287538 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6783cb2c-ecb0-45f8-b0b8-ea992b2f47fe tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:44.288312 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6783cb2c-ecb0-45f8-b0b8-ea992b2f47fe tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:44.288917 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6783cb2c-ecb0-45f8-b0b8-ea992b2f47fe tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:44.289357 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.objects.instance [None req-6783cb2c-ecb0-45f8-b0b8-ea992b2f47fe tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lazy-loading 'fault' on Instance uuid 3e390b45-0b39-4429-9431-7ee6af3806e6 {{(pid=120440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 01:59:44.330812 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-6783cb2c-ecb0-45f8-b0b8-ea992b2f47fe tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:44.346259 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-6783cb2c-ecb0-45f8-b0b8-ea992b2f47fe tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:44.348259 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-6783cb2c-ecb0-45f8-b0b8-ea992b2f47fe tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:44.349439 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-6783cb2c-ecb0-45f8-b0b8-ea992b2f47fe tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 200 len: 1372 microversion: 2.20 time: 0.111881 Sep 16 01:59:44.350001 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 301/616] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:59:44 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 1372 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:59:45.379000 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-6745a30d-264f-4566-aed2-73d3a6936734 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:45.379722 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-6745a30d-264f-4566-aed2-73d3a6936734 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:45.386197 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-6745a30d-264f-4566-aed2-73d3a6936734 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:45.386671 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-6745a30d-264f-4566-aed2-73d3a6936734 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:45.387099 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-6745a30d-264f-4566-aed2-73d3a6936734 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:45.387783 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-6745a30d-264f-4566-aed2-73d3a6936734 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:45.388255 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-6745a30d-264f-4566-aed2-73d3a6936734 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:45.389578 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-6745a30d-264f-4566-aed2-73d3a6936734 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:45.403289 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.wsgi [None req-6745a30d-264f-4566-aed2-73d3a6936734 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] HTTP exception thrown: Instance 3e390b45-0b39-4429-9431-7ee6af3806e6 could not be found. Sep 16 01:59:45.405782 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-6745a30d-264f-4566-aed2-73d3a6936734 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Request method failure captured: Sep 16 01:59:45.405782 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: request: GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 HTTP/1.1 Sep 16 01:59:45.405782 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Accept: application/json Sep 16 01:59:45.405782 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Accept-Encoding: identity Sep 16 01:59:45.405782 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Connection: close Sep 16 01:59:45.405782 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Content-Length: 0 Sep 16 01:59:45.405782 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Content-Type: application/json Sep 16 01:59:45.405782 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Host: 10.222.0.42 Sep 16 01:59:45.405782 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Openstack-System-Scope: None Sep 16 01:59:45.405782 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: User-Agent: python-urllib3/1.26.12 Sep 16 01:59:45.405782 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Auth-Token: gAAAAABjI9c44XauSCW-l4VA0O-h9qlJRhm6qcbICunUoHrFT4-QwVCyMa6SNEM6ALN1WCZA4M1vQ-Pz1dpN0-7E5dsSrv6OvjIJkpEgILOZoYFEFnJbJ0ig42KuV1P3aDuoOZUNY3HiqsAqqaFuZFyDieW3vfVRtVQ8D0Leui0aNPQ8OZDgYDI Sep 16 01:59:45.405782 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Domain-Id: None Sep 16 01:59:45.405782 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Domain-Name: None Sep 16 01:59:45.405782 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Identity-Status: Confirmed Sep 16 01:59:45.405782 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Is-Admin-Project: True Sep 16 01:59:45.405782 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Openstack-Nova-Api-Version: 2.20 Sep 16 01:59:45.405782 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Domain-Id: default Sep 16 01:59:45.405782 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Domain-Name: Default Sep 16 01:59:45.405782 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Id: 1377f60423c64a1786203deb55ae55ef Sep 16 01:59:45.405782 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1249782334 Sep 16 01:59:45.405782 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Role: member,reader Sep 16 01:59:45.405782 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Roles: member,reader Sep 16 01:59:45.407393 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1377f60423c64a1786203deb55ae55ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1377f60423c64a1786203deb55ae55ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1377f60423c64a1786203deb55ae55ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1377f60423c64a1786203deb55ae55ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 01:59:45.407393 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1249782334 Sep 16 01:59:45.407393 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant-Id: 1377f60423c64a1786203deb55ae55ef Sep 16 01:59:45.407393 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1249782334 Sep 16 01:59:45.407393 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User: tempest-AttachVolumeShelveTestJSON-1249782334-project Sep 16 01:59:45.407393 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Domain-Id: default Sep 16 01:59:45.407393 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Domain-Name: Default Sep 16 01:59:45.407393 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Id: dd95ef263d15460f9cca5a7557cbee2e Sep 16 01:59:45.407393 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1249782334-project Sep 16 01:59:45.407393 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: method: > Sep 16 01:59:45.407393 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: exception: Instance 3e390b45-0b39-4429-9431-7ee6af3806e6 could not be found. Sep 16 01:59:45.407393 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: action_args: {'id': '3e390b45-0b39-4429-9431-7ee6af3806e6'} Sep 16 01:59:45.408319 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 01:59:45.408319 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:59:45.408319 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 01:59:45.408319 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 01:59:45.408319 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 01:59:45.408319 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 01:59:45.408319 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 01:59:45.408319 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 01:59:45.408319 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 01:59:45.408319 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 01:59:45.408319 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e390b45-0b39-4429-9431-7ee6af3806e6 could not be found. Sep 16 01:59:45.408319 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:59:45.408319 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:59:45.408319 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:59:45.408319 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:59:45.408319 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 01:59:45.408319 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 01:59:45.408319 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 01:59:45.408319 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 01:59:45.408319 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 01:59:45.409728 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 01:59:45.409728 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 01:59:45.409728 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 01:59:45.409728 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 01:59:45.409728 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 01:59:45.409728 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 01:59:45.409728 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 01:59:45.409728 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e390b45-0b39-4429-9431-7ee6af3806e6 could not be found. Sep 16 01:59:45.409728 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:59:45.409728 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 01:59:45.409728 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:59:45.409728 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 01:59:45.409728 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 01:59:45.409728 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 01:59:45.409728 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 01:59:45.409728 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 01:59:45.409728 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e390b45-0b39-4429-9431-7ee6af3806e6 could not be found. Sep 16 01:59:45.409728 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 01:59:45.411231 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-6745a30d-264f-4566-aed2-73d3a6936734 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Returning 404 to user: Instance 3e390b45-0b39-4429-9431-7ee6af3806e6 could not be found. {{(pid=120441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 01:59:45.411231 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-6745a30d-264f-4566-aed2-73d3a6936734 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 404 len: 111 microversion: 2.20 time: 0.033207 Sep 16 01:59:45.411231 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 316/617] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:59:45 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 01:59:45.418642 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-a8d71c2e-c2f6-4b0c-a006-fe2830edd90d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '.version_select at 0x7fae329c3ca0>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:45.447324 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-a8d71c2e-c2f6-4b0c-a006-fe2830edd90d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1924274324" status: 204 len: 0 microversion: 2.20 time: 0.034335 Sep 16 01:59:45.447902 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 302/618] 10.222.0.42 () {60 vars in 1262 bytes} [Fri Sep 16 01:59:45 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1924274324 => generated 0 bytes in 36 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 16 01:59:46.167958 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-b245df31-5b8f-43fc-9e57-97d162f12afd tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Action: 'create', calling method: .version_select at 0x7fae362a0280>, body: {"keypair": {"name": "tempest-keypair-619814303", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBL77c0r0MGtbOnPaHQu/dHMg1X2v8kjk/HxmrhLs8SH1SnSmwlw1NjlConP5gaYsojYVhmS/KhbCRbGWQu95fKPivqpDWTcV+vyYWkmwVQpSNwJYL+/KW/Yd+SSoQ4gnKw=="}} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:59:46.188123 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.quota [None req-b245df31-5b8f-43fc-9e57-97d162f12afd tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Getting quotas for project 1377f60423c64a1786203deb55ae55ef. Resources: {'key_pairs'} {{(pid=120441) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 01:59:46.192198 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.quota [None req-b245df31-5b8f-43fc-9e57-97d162f12afd tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Getting quotas for user dd95ef263d15460f9cca5a7557cbee2e and project 1377f60423c64a1786203deb55ae55ef. Resources: {'key_pairs'} {{(pid=120441) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 01:59:46.219479 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-b245df31-5b8f-43fc-9e57-97d162f12afd tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 201 len: 400 microversion: 2.20 time: 0.055507 Sep 16 01:59:46.220131 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 317/619] 10.222.0.42 () {62 vars in 1200 bytes} [Fri Sep 16 01:59:46 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 57 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 16 01:59:47.413837 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-e270648a-7ebc-4b23-972c-38f385c2686d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-662609583", "imageRef": "1546da04-912c-44c6-b4b9-34fba35e08f6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "37ec5744-bfab-42fe-b2e4-a18259c0344e"}], "security_groups": [{"name": "tempest-securitygroup--1270352076"}], "key_name": "tempest-keypair-619814303", "user_data": "}} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:59:47.517185 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.network.neutron [None req-e270648a-7ebc-4b23-972c-38f385c2686d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] validate_networks() for [('37ec5744-bfab-42fe-b2e4-a18259c0344e', None, None, None, None, None)] {{(pid=120440) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 01:59:47.931305 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.virt.hardware [None req-e270648a-7ebc-4b23-972c-38f385c2686d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Flavor limits 0:0:0 {{(pid=120440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 01:59:47.931729 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.virt.hardware [None req-e270648a-7ebc-4b23-972c-38f385c2686d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Image limits 0:0:0 {{(pid=120440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 01:59:47.932227 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.virt.hardware [None req-e270648a-7ebc-4b23-972c-38f385c2686d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Flavor pref 0:0:0 {{(pid=120440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 01:59:47.932635 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.virt.hardware [None req-e270648a-7ebc-4b23-972c-38f385c2686d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Image pref 0:0:0 {{(pid=120440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 01:59:47.933058 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.virt.hardware [None req-e270648a-7ebc-4b23-972c-38f385c2686d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 01:59:47.942267 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e270648a-7ebc-4b23-972c-38f385c2686d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:47.942741 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e270648a-7ebc-4b23-972c-38f385c2686d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:47.943173 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e270648a-7ebc-4b23-972c-38f385c2686d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:47.943894 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e270648a-7ebc-4b23-972c-38f385c2686d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:47.944385 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e270648a-7ebc-4b23-972c-38f385c2686d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:47.944808 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e270648a-7ebc-4b23-972c-38f385c2686d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:47.951963 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=1 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:47.963398 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.quota [None req-e270648a-7ebc-4b23-972c-38f385c2686d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Getting quotas for project 1377f60423c64a1786203deb55ae55ef. Resources: {'cores', 'ram', 'instances'} {{(pid=120440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 01:59:47.967394 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.quota [None req-e270648a-7ebc-4b23-972c-38f385c2686d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Getting quotas for user dd95ef263d15460f9cca5a7557cbee2e and project 1377f60423c64a1786203deb55ae55ef. Resources: {'cores', 'ram', 'instances'} {{(pid=120440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 01:59:47.978009 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-e270648a-7ebc-4b23-972c-38f385c2686d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Going to run 1 instances... {{(pid=120440) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 01:59:47.980294 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-e270648a-7ebc-4b23-972c-38f385c2686d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1546da04-912c-44c6-b4b9-34fba35e08f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 01:59:48.027994 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-e270648a-7ebc-4b23-972c-38f385c2686d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 0.618331 Sep 16 01:59:48.028885 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 303/620] 10.222.0.42 () {62 vars in 1188 bytes} [Fri Sep 16 01:59:47 2022] POST /compute/v2.1/servers => generated 402 bytes in 620 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 16 01:59:48.041591 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-01e07c21-26af-4684-a59a-855040329856 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:48.042200 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-01e07c21-26af-4684-a59a-855040329856 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:48.098175 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-01e07c21-26af-4684-a59a-855040329856 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:48.105416 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-01e07c21-26af-4684-a59a-855040329856 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:48.107964 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-01e07c21-26af-4684-a59a-855040329856 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:48.109149 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-01e07c21-26af-4684-a59a-855040329856 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1280 microversion: 2.20 time: 0.072048 Sep 16 01:59:48.109710 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 318/621] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:59:48 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1280 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:59:49.135502 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-b4ecfbe4-152e-43fc-b1bf-2607e92d8e14 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:49.136138 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-b4ecfbe4-152e-43fc-b1bf-2607e92d8e14 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:49.142343 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b4ecfbe4-152e-43fc-b1bf-2607e92d8e14 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:49.142845 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b4ecfbe4-152e-43fc-b1bf-2607e92d8e14 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:49.143275 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b4ecfbe4-152e-43fc-b1bf-2607e92d8e14 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:49.143959 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b4ecfbe4-152e-43fc-b1bf-2607e92d8e14 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:49.144409 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b4ecfbe4-152e-43fc-b1bf-2607e92d8e14 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:49.144827 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b4ecfbe4-152e-43fc-b1bf-2607e92d8e14 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:49.206924 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-b4ecfbe4-152e-43fc-b1bf-2607e92d8e14 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:49.214780 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-b4ecfbe4-152e-43fc-b1bf-2607e92d8e14 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:49.216725 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-b4ecfbe4-152e-43fc-b1bf-2607e92d8e14 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:49.218197 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-b4ecfbe4-152e-43fc-b1bf-2607e92d8e14 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1332 microversion: 2.20 time: 0.087054 Sep 16 01:59:49.218750 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 304/622] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:59:49 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1332 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:59:50.243883 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-5b18c025-b9eb-49e4-be9d-b23a1711459e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:50.244707 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-5b18c025-b9eb-49e4-be9d-b23a1711459e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:50.251643 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5b18c025-b9eb-49e4-be9d-b23a1711459e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:50.252585 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5b18c025-b9eb-49e4-be9d-b23a1711459e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:50.253008 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5b18c025-b9eb-49e4-be9d-b23a1711459e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:50.253709 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5b18c025-b9eb-49e4-be9d-b23a1711459e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:50.254516 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5b18c025-b9eb-49e4-be9d-b23a1711459e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:50.254691 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5b18c025-b9eb-49e4-be9d-b23a1711459e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:50.755359 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-5b18c025-b9eb-49e4-be9d-b23a1711459e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:50.763955 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-5b18c025-b9eb-49e4-be9d-b23a1711459e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:50.765989 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-5b18c025-b9eb-49e4-be9d-b23a1711459e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:50.767115 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-5b18c025-b9eb-49e4-be9d-b23a1711459e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1406 microversion: 2.20 time: 0.527919 Sep 16 01:59:50.767667 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 319/623] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:59:50 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1406 bytes in 529 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:59:51.331587 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [req-93827f3b-180e-43f9-9c32-784e029b758a req-9c5e4398-7330-419a-bace-ada06ab1d17b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3582769d-4f26-4b4d-b2d9-e9638db93366", "tag": "4127457c-ae36-44e0-abd0-2ee3fefef488"}]} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:59:51.342265 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-93827f3b-180e-43f9-9c32-784e029b758a req-9c5e4398-7330-419a-bace-ada06ab1d17b service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:51.342750 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-93827f3b-180e-43f9-9c32-784e029b758a req-9c5e4398-7330-419a-bace-ada06ab1d17b service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:51.343192 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-93827f3b-180e-43f9-9c32-784e029b758a req-9c5e4398-7330-419a-bace-ada06ab1d17b service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:51.361202 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.compute.server_external_events [req-93827f3b-180e-43f9-9c32-784e029b758a req-9c5e4398-7330-419a-bace-ada06ab1d17b service nova] Creating event network-changed:4127457c-ae36-44e0-abd0-2ee3fefef488 for instance 3582769d-4f26-4b4d-b2d9-e9638db93366 on hv-cinder-84914 Sep 16 01:59:51.366592 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [req-93827f3b-180e-43f9-9c32-784e029b758a req-9c5e4398-7330-419a-bace-ada06ab1d17b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038624 Sep 16 01:59:51.367212 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 305/624] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 01:59:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:59:51.792686 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-2b20ebe5-1376-4cda-802e-754db59d1cbd tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:51.793318 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-2b20ebe5-1376-4cda-802e-754db59d1cbd tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:51.801031 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2b20ebe5-1376-4cda-802e-754db59d1cbd tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:51.801515 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2b20ebe5-1376-4cda-802e-754db59d1cbd tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:51.802167 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2b20ebe5-1376-4cda-802e-754db59d1cbd tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:51.802860 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2b20ebe5-1376-4cda-802e-754db59d1cbd tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:51.803306 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2b20ebe5-1376-4cda-802e-754db59d1cbd tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:51.803726 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2b20ebe5-1376-4cda-802e-754db59d1cbd tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:51.939629 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-2b20ebe5-1376-4cda-802e-754db59d1cbd tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:51.947856 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-2b20ebe5-1376-4cda-802e-754db59d1cbd tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:51.949370 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-2b20ebe5-1376-4cda-802e-754db59d1cbd tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:51.950472 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-2b20ebe5-1376-4cda-802e-754db59d1cbd tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1406 microversion: 2.20 time: 0.161678 Sep 16 01:59:51.951781 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 320/625] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:59:51 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:59:52.977647 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-a2e5df15-0503-4df3-8642-db28e45a62cd tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:52.978347 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-a2e5df15-0503-4df3-8642-db28e45a62cd tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:52.985267 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a2e5df15-0503-4df3-8642-db28e45a62cd tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:52.985752 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a2e5df15-0503-4df3-8642-db28e45a62cd tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:52.986186 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a2e5df15-0503-4df3-8642-db28e45a62cd tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:52.986876 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a2e5df15-0503-4df3-8642-db28e45a62cd tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:52.987324 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a2e5df15-0503-4df3-8642-db28e45a62cd tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:52.987746 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a2e5df15-0503-4df3-8642-db28e45a62cd tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:53.117854 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-a2e5df15-0503-4df3-8642-db28e45a62cd tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:53.125904 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-a2e5df15-0503-4df3-8642-db28e45a62cd tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:53.127608 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-a2e5df15-0503-4df3-8642-db28e45a62cd tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:53.128732 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-a2e5df15-0503-4df3-8642-db28e45a62cd tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1406 microversion: 2.20 time: 0.155830 Sep 16 01:59:53.129280 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 306/626] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:59:52 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:59:54.155105 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-e49b83d1-a0d0-4c11-91bb-da617042e1aa tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:54.155713 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-e49b83d1-a0d0-4c11-91bb-da617042e1aa tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:54.157659 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_api:SELECT=48,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:54.162796 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e49b83d1-a0d0-4c11-91bb-da617042e1aa tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:54.163267 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e49b83d1-a0d0-4c11-91bb-da617042e1aa tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:54.163693 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e49b83d1-a0d0-4c11-91bb-da617042e1aa tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:54.164396 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e49b83d1-a0d0-4c11-91bb-da617042e1aa tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:54.164839 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e49b83d1-a0d0-4c11-91bb-da617042e1aa tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:54.165252 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e49b83d1-a0d0-4c11-91bb-da617042e1aa tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:54.293921 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-e49b83d1-a0d0-4c11-91bb-da617042e1aa tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:54.302844 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-e49b83d1-a0d0-4c11-91bb-da617042e1aa tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:54.304290 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-e49b83d1-a0d0-4c11-91bb-da617042e1aa tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:54.305377 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-e49b83d1-a0d0-4c11-91bb-da617042e1aa tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1406 microversion: 2.20 time: 0.155308 Sep 16 01:59:54.305927 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 321/627] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:59:54 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1406 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:59:55.331735 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-e17c1873-9adf-4c68-8d8b-34dea151e6d0 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:55.332373 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-e17c1873-9adf-4c68-8d8b-34dea151e6d0 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:55.338738 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e17c1873-9adf-4c68-8d8b-34dea151e6d0 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:55.339227 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e17c1873-9adf-4c68-8d8b-34dea151e6d0 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:55.339668 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e17c1873-9adf-4c68-8d8b-34dea151e6d0 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:55.340386 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e17c1873-9adf-4c68-8d8b-34dea151e6d0 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:55.340847 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e17c1873-9adf-4c68-8d8b-34dea151e6d0 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:55.341277 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e17c1873-9adf-4c68-8d8b-34dea151e6d0 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:55.468233 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-e17c1873-9adf-4c68-8d8b-34dea151e6d0 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:55.476308 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-e17c1873-9adf-4c68-8d8b-34dea151e6d0 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:55.477763 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-e17c1873-9adf-4c68-8d8b-34dea151e6d0 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:55.478889 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-e17c1873-9adf-4c68-8d8b-34dea151e6d0 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1406 microversion: 2.20 time: 0.152148 Sep 16 01:59:55.479419 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 307/628] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:59:55 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:59:56.505483 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-61db771c-a107-4bf8-86e6-5353d0b754ca tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:56.506087 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-61db771c-a107-4bf8-86e6-5353d0b754ca tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:56.513331 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-61db771c-a107-4bf8-86e6-5353d0b754ca tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:56.513817 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-61db771c-a107-4bf8-86e6-5353d0b754ca tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:56.514294 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-61db771c-a107-4bf8-86e6-5353d0b754ca tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:56.515038 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-61db771c-a107-4bf8-86e6-5353d0b754ca tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:56.515490 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-61db771c-a107-4bf8-86e6-5353d0b754ca tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:56.515910 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-61db771c-a107-4bf8-86e6-5353d0b754ca tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:56.647588 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-61db771c-a107-4bf8-86e6-5353d0b754ca tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:56.659755 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-61db771c-a107-4bf8-86e6-5353d0b754ca tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:56.661224 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-61db771c-a107-4bf8-86e6-5353d0b754ca tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:56.662310 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-61db771c-a107-4bf8-86e6-5353d0b754ca tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1406 microversion: 2.20 time: 0.161662 Sep 16 01:59:56.662862 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 322/629] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:59:56 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:59:57.687855 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-ef853f5d-4527-47e7-a484-7ec5a44371fb tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:57.688430 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-ef853f5d-4527-47e7-a484-7ec5a44371fb tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:57.694598 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ef853f5d-4527-47e7-a484-7ec5a44371fb tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:57.695068 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ef853f5d-4527-47e7-a484-7ec5a44371fb tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:57.695494 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ef853f5d-4527-47e7-a484-7ec5a44371fb tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:57.696201 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ef853f5d-4527-47e7-a484-7ec5a44371fb tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:57.696646 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ef853f5d-4527-47e7-a484-7ec5a44371fb tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:57.697061 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ef853f5d-4527-47e7-a484-7ec5a44371fb tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:57.828587 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-ef853f5d-4527-47e7-a484-7ec5a44371fb tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:57.836580 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-ef853f5d-4527-47e7-a484-7ec5a44371fb tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:57.838013 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-ef853f5d-4527-47e7-a484-7ec5a44371fb tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:57.839092 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-ef853f5d-4527-47e7-a484-7ec5a44371fb tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1406 microversion: 2.20 time: 0.155727 Sep 16 01:59:57.839642 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 308/630] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:59:57 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 01:59:58.864816 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-f9884acb-f4e3-4f04-a21c-4a5cafe8c03e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 01:59:58.865427 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-f9884acb-f4e3-4f04-a21c-4a5cafe8c03e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 01:59:58.867911 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell0:SELECT=6 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:58.873974 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f9884acb-f4e3-4f04-a21c-4a5cafe8c03e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:58.874482 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f9884acb-f4e3-4f04-a21c-4a5cafe8c03e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:58.874879 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f9884acb-f4e3-4f04-a21c-4a5cafe8c03e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:58.875574 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f9884acb-f4e3-4f04-a21c-4a5cafe8c03e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:58.876062 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f9884acb-f4e3-4f04-a21c-4a5cafe8c03e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:58.876462 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f9884acb-f4e3-4f04-a21c-4a5cafe8c03e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:58.881990 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell0:SELECT=2 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:58.881990 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell0:SELECT=6 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 01:59:58.937123 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [req-3869a87b-cabc-431f-be88-81584293c941 req-af15ff53-45c2-4c35-a819-cea556861e8c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3582769d-4f26-4b4d-b2d9-e9638db93366", "name": "network-vif-plugged", "status": "completed", "tag": "4127457c-ae36-44e0-abd0-2ee3fefef488"}]} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 01:59:58.946861 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-3869a87b-cabc-431f-be88-81584293c941 req-af15ff53-45c2-4c35-a819-cea556861e8c service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 01:59:58.947341 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-3869a87b-cabc-431f-be88-81584293c941 req-af15ff53-45c2-4c35-a819-cea556861e8c service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 01:59:58.947767 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-3869a87b-cabc-431f-be88-81584293c941 req-af15ff53-45c2-4c35-a819-cea556861e8c service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 01:59:58.961619 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.compute.server_external_events [req-3869a87b-cabc-431f-be88-81584293c941 req-af15ff53-45c2-4c35-a819-cea556861e8c service nova] Creating event network-vif-plugged:4127457c-ae36-44e0-abd0-2ee3fefef488 for instance 3582769d-4f26-4b4d-b2d9-e9638db93366 on hv-cinder-84914 Sep 16 01:59:58.967517 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [req-3869a87b-cabc-431f-be88-81584293c941 req-af15ff53-45c2-4c35-a819-cea556861e8c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.098574 Sep 16 01:59:58.968011 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 309/631] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 01:59:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 01:59:59.017693 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-f9884acb-f4e3-4f04-a21c-4a5cafe8c03e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:59.027352 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-f9884acb-f4e3-4f04-a21c-4a5cafe8c03e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:59.029663 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-f9884acb-f4e3-4f04-a21c-4a5cafe8c03e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 01:59:59.031163 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-f9884acb-f4e3-4f04-a21c-4a5cafe8c03e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1406 microversion: 2.20 time: 0.170171 Sep 16 01:59:59.032087 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 323/632] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 01:59:58 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1406 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 02:00:00.057812 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-7e7e0402-012c-4a75-b9fa-746364d9c385 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:00:00.058497 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-7e7e0402-012c-4a75-b9fa-746364d9c385 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:00:00.065350 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7e7e0402-012c-4a75-b9fa-746364d9c385 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:00.065821 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7e7e0402-012c-4a75-b9fa-746364d9c385 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:00.066249 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7e7e0402-012c-4a75-b9fa-746364d9c385 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:00.066921 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7e7e0402-012c-4a75-b9fa-746364d9c385 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:00.067365 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7e7e0402-012c-4a75-b9fa-746364d9c385 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:00.067783 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7e7e0402-012c-4a75-b9fa-746364d9c385 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:00.192488 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-7e7e0402-012c-4a75-b9fa-746364d9c385 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:00:00.200907 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-7e7e0402-012c-4a75-b9fa-746364d9c385 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:00:00.202339 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-7e7e0402-012c-4a75-b9fa-746364d9c385 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:00:00.203425 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-7e7e0402-012c-4a75-b9fa-746364d9c385 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1406 microversion: 2.20 time: 0.150335 Sep 16 02:00:00.203980 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 310/633] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:00:00 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1406 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:00:01.229084 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-dfaf8697-832f-48d4-8ef6-f55f8bebebe2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:00:01.229685 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-dfaf8697-832f-48d4-8ef6-f55f8bebebe2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:00:01.236287 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-dfaf8697-832f-48d4-8ef6-f55f8bebebe2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:01.236762 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-dfaf8697-832f-48d4-8ef6-f55f8bebebe2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:01.237190 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-dfaf8697-832f-48d4-8ef6-f55f8bebebe2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:01.237866 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-dfaf8697-832f-48d4-8ef6-f55f8bebebe2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:01.238305 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-dfaf8697-832f-48d4-8ef6-f55f8bebebe2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:01.238718 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-dfaf8697-832f-48d4-8ef6-f55f8bebebe2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:01.375079 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-dfaf8697-832f-48d4-8ef6-f55f8bebebe2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:00:01.384796 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-dfaf8697-832f-48d4-8ef6-f55f8bebebe2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:00:01.386237 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-dfaf8697-832f-48d4-8ef6-f55f8bebebe2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:00:01.387340 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-dfaf8697-832f-48d4-8ef6-f55f8bebebe2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1406 microversion: 2.20 time: 0.163681 Sep 16 02:00:01.388168 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 324/634] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:00:01 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1406 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:00:02.413619 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-1b85de02-43a7-4790-89ff-54795fe4d3ee tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:00:02.414229 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-1b85de02-43a7-4790-89ff-54795fe4d3ee tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:00:02.420058 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1b85de02-43a7-4790-89ff-54795fe4d3ee tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:02.420738 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1b85de02-43a7-4790-89ff-54795fe4d3ee tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:02.421182 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1b85de02-43a7-4790-89ff-54795fe4d3ee tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:02.421876 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1b85de02-43a7-4790-89ff-54795fe4d3ee tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:02.422339 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1b85de02-43a7-4790-89ff-54795fe4d3ee tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:02.422768 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1b85de02-43a7-4790-89ff-54795fe4d3ee tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:02.551558 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-1b85de02-43a7-4790-89ff-54795fe4d3ee tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:00:02.559550 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-1b85de02-43a7-4790-89ff-54795fe4d3ee tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:00:02.561617 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-1b85de02-43a7-4790-89ff-54795fe4d3ee tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:00:02.563051 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-1b85de02-43a7-4790-89ff-54795fe4d3ee tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1599 microversion: 2.20 time: 0.153545 Sep 16 02:00:02.563604 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 311/635] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:00:02 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1599 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:00:02.589101 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-0c224a10-48ab-4b24-bcc4-55968efd952f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:00:02.589666 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-0c224a10-48ab-4b24-bcc4-55968efd952f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:00:02.596467 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0c224a10-48ab-4b24-bcc4-55968efd952f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:02.596958 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0c224a10-48ab-4b24-bcc4-55968efd952f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:02.597399 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0c224a10-48ab-4b24-bcc4-55968efd952f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:02.598105 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0c224a10-48ab-4b24-bcc4-55968efd952f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:02.598551 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0c224a10-48ab-4b24-bcc4-55968efd952f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:02.598987 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0c224a10-48ab-4b24-bcc4-55968efd952f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:02.676958 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-0c224a10-48ab-4b24-bcc4-55968efd952f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.092098 Sep 16 02:00:02.677811 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 325/636] 10.222.0.42 () {60 vars in 1316 bytes} [Fri Sep 16 02:00:02 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 02:00:03.604177 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [req-00688cf8-62eb-49da-8517-b6e7597f534f req-3ed9eedd-3d1f-4c1a-9afe-c16643adc542 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "3582769d-4f26-4b4d-b2d9-e9638db93366", "tag": "4127457c-ae36-44e0-abd0-2ee3fefef488"}]} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:00:03.610424 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_api:SELECT=48,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:00:03.616597 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-00688cf8-62eb-49da-8517-b6e7597f534f req-3ed9eedd-3d1f-4c1a-9afe-c16643adc542 service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:03.617078 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-00688cf8-62eb-49da-8517-b6e7597f534f req-3ed9eedd-3d1f-4c1a-9afe-c16643adc542 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:03.617504 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-00688cf8-62eb-49da-8517-b6e7597f534f req-3ed9eedd-3d1f-4c1a-9afe-c16643adc542 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:03.631380 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.compute.server_external_events [req-00688cf8-62eb-49da-8517-b6e7597f534f req-3ed9eedd-3d1f-4c1a-9afe-c16643adc542 service nova] Creating event network-changed:4127457c-ae36-44e0-abd0-2ee3fefef488 for instance 3582769d-4f26-4b4d-b2d9-e9638db93366 on hv-cinder-84914 Sep 16 02:00:03.636780 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [req-00688cf8-62eb-49da-8517-b6e7597f534f req-3ed9eedd-3d1f-4c1a-9afe-c16643adc542 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036134 Sep 16 02:00:03.637400 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 312/637] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:00:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:00:18.410389 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_api:SELECT=9 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:00:18.411759 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell1:SELECT=53,nova_cell1:INSERT=1 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:00:18.418944 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-486f2bae-a811-48bc-b573-73c4078e6cbf tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:00:18.422183 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-486f2bae-a811-48bc-b573-73c4078e6cbf tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:00:18.429433 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-486f2bae-a811-48bc-b573-73c4078e6cbf tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:18.429929 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-486f2bae-a811-48bc-b573-73c4078e6cbf tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:18.430357 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-486f2bae-a811-48bc-b573-73c4078e6cbf tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:18.431040 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-486f2bae-a811-48bc-b573-73c4078e6cbf tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:18.431488 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-486f2bae-a811-48bc-b573-73c4078e6cbf tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:18.431906 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-486f2bae-a811-48bc-b573-73c4078e6cbf tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:18.465976 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-486f2bae-a811-48bc-b573-73c4078e6cbf tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.056973 Sep 16 02:00:18.467056 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 326/638] 10.222.0.42 () {58 vars in 1302 bytes} [Fri Sep 16 02:00:18 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763/os-volume_attachments => generated 25 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 02:00:18.527580 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell1:SELECT=43 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:00:18.532935 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-53694b2e-dbb8-411b-b00d-59960d3035c8 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:00:18.533516 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-53694b2e-dbb8-411b-b00d-59960d3035c8 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:00:18.540010 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-53694b2e-dbb8-411b-b00d-59960d3035c8 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:18.540567 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-53694b2e-dbb8-411b-b00d-59960d3035c8 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:18.541197 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-53694b2e-dbb8-411b-b00d-59960d3035c8 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:18.541877 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-53694b2e-dbb8-411b-b00d-59960d3035c8 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:18.542326 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-53694b2e-dbb8-411b-b00d-59960d3035c8 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:18.542746 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-53694b2e-dbb8-411b-b00d-59960d3035c8 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:18.568235 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-53694b2e-dbb8-411b-b00d-59960d3035c8 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Going to try to terminate instance {{(pid=120440) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 02:00:18.643020 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-53694b2e-dbb8-411b-b00d-59960d3035c8 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "DELETE /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 204 len: 0 microversion: 2.1 time: 0.116596 Sep 16 02:00:18.643520 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 313/639] 10.222.0.42 () {58 vars in 1239 bytes} [Fri Sep 16 02:00:18 2022] DELETE /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 16 02:00:18.651691 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-4bdb4fa0-8ef9-4317-a654-5a555cb4a742 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:00:18.652334 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-4bdb4fa0-8ef9-4317-a654-5a555cb4a742 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:00:18.659006 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4bdb4fa0-8ef9-4317-a654-5a555cb4a742 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:18.659498 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4bdb4fa0-8ef9-4317-a654-5a555cb4a742 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:18.659969 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4bdb4fa0-8ef9-4317-a654-5a555cb4a742 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:18.660658 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4bdb4fa0-8ef9-4317-a654-5a555cb4a742 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:18.661115 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4bdb4fa0-8ef9-4317-a654-5a555cb4a742 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:18.661542 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4bdb4fa0-8ef9-4317-a654-5a555cb4a742 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:18.791571 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-4bdb4fa0-8ef9-4317-a654-5a555cb4a742 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:00:18.799340 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-4bdb4fa0-8ef9-4317-a654-5a555cb4a742 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1674 microversion: 2.1 time: 0.151597 Sep 16 02:00:18.799897 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 327/640] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:00:18 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1674 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:00:19.829975 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-22e92f3b-bdbd-425b-9b6e-d9e28afe7199 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:00:19.830665 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-22e92f3b-bdbd-425b-9b6e-d9e28afe7199 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:00:19.836984 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-22e92f3b-bdbd-425b-9b6e-d9e28afe7199 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:19.837460 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-22e92f3b-bdbd-425b-9b6e-d9e28afe7199 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:19.837885 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-22e92f3b-bdbd-425b-9b6e-d9e28afe7199 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:19.838555 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-22e92f3b-bdbd-425b-9b6e-d9e28afe7199 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:19.838998 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-22e92f3b-bdbd-425b-9b6e-d9e28afe7199 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:19.839411 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-22e92f3b-bdbd-425b-9b6e-d9e28afe7199 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:19.973752 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-22e92f3b-bdbd-425b-9b6e-d9e28afe7199 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:00:19.982546 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-22e92f3b-bdbd-425b-9b6e-d9e28afe7199 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1674 microversion: 2.1 time: 0.156853 Sep 16 02:00:19.984526 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 314/641] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:00:19 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1674 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:00:21.006958 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-e80f7e33-66c4-497f-8e68-ccb35cde70d6 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:00:21.007691 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-e80f7e33-66c4-497f-8e68-ccb35cde70d6 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:00:21.014654 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e80f7e33-66c4-497f-8e68-ccb35cde70d6 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:21.015330 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e80f7e33-66c4-497f-8e68-ccb35cde70d6 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:21.015857 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e80f7e33-66c4-497f-8e68-ccb35cde70d6 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:21.016703 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e80f7e33-66c4-497f-8e68-ccb35cde70d6 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:21.017227 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e80f7e33-66c4-497f-8e68-ccb35cde70d6 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:21.017722 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e80f7e33-66c4-497f-8e68-ccb35cde70d6 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:21.103660 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [req-5f6c2345-83b4-4fa2-971e-2460075b64ae req-c1177599-cdf0-4599-9482-3ebf9ad45ebc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "df8bdee8-15d2-4b18-a2d0-8b24b43f6763", "name": "network-vif-deleted", "tag": "32e8d554-2d45-428d-8c7c-03347e83c61a"}]} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:00:21.107657 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-e80f7e33-66c4-497f-8e68-ccb35cde70d6 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:00:21.119037 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-e80f7e33-66c4-497f-8e68-ccb35cde70d6 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 200 len: 1606 microversion: 2.1 time: 0.115658 Sep 16 02:00:21.120836 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-5f6c2345-83b4-4fa2-971e-2460075b64ae req-c1177599-cdf0-4599-9482-3ebf9ad45ebc service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:21.121554 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-5f6c2345-83b4-4fa2-971e-2460075b64ae req-c1177599-cdf0-4599-9482-3ebf9ad45ebc service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:21.122056 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-5f6c2345-83b4-4fa2-971e-2460075b64ae req-c1177599-cdf0-4599-9482-3ebf9ad45ebc service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:21.132921 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 328/642] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:00:21 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 1606 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:00:21.136568 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.compute.server_external_events [req-5f6c2345-83b4-4fa2-971e-2460075b64ae req-c1177599-cdf0-4599-9482-3ebf9ad45ebc service nova] Creating event network-vif-deleted:32e8d554-2d45-428d-8c7c-03347e83c61a for instance df8bdee8-15d2-4b18-a2d0-8b24b43f6763 on hv-cinder-84914 Sep 16 02:00:21.140573 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [req-5f6c2345-83b4-4fa2-971e-2460075b64ae req-c1177599-cdf0-4599-9482-3ebf9ad45ebc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050868 Sep 16 02:00:21.141491 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 315/643] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:00:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:00:22.144275 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-621b6831-91a3-425b-98e7-257d106df9cd tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:00:22.144884 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-621b6831-91a3-425b-98e7-257d106df9cd tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:00:22.150698 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-621b6831-91a3-425b-98e7-257d106df9cd tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:22.151172 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-621b6831-91a3-425b-98e7-257d106df9cd tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:22.151598 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-621b6831-91a3-425b-98e7-257d106df9cd tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:22.152306 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-621b6831-91a3-425b-98e7-257d106df9cd tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:22.152751 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-621b6831-91a3-425b-98e7-257d106df9cd tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:22.153167 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-621b6831-91a3-425b-98e7-257d106df9cd tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:22.166803 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.wsgi [None req-621b6831-91a3-425b-98e7-257d106df9cd tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] HTTP exception thrown: Instance df8bdee8-15d2-4b18-a2d0-8b24b43f6763 could not be found. Sep 16 02:00:22.168332 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-621b6831-91a3-425b-98e7-257d106df9cd tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Request method failure captured: Sep 16 02:00:22.168332 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: request: GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 HTTP/1.1 Sep 16 02:00:22.168332 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Accept: application/json Sep 16 02:00:22.168332 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Accept-Encoding: identity Sep 16 02:00:22.168332 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Connection: close Sep 16 02:00:22.168332 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Content-Length: 0 Sep 16 02:00:22.168332 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Content-Type: application/json Sep 16 02:00:22.168332 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Host: 10.222.0.42 Sep 16 02:00:22.168332 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Openstack-System-Scope: None Sep 16 02:00:22.168332 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: User-Agent: python-urllib3/1.26.12 Sep 16 02:00:22.168332 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Auth-Token: gAAAAABjI9c5m0JwV558PKGOeHNSUgxacR_33r1uAN-rfBRY-HMfoYiGQstlScCIjb6UGFB5kk4_TmIw8v_iJxaibF6dXSM_npfV-jnRA1BFwfavqM1Nh_4mHwaP3tGBAg4_o-KWd6IJRTlJIq8txMlwyESHhlcR7bqDqc8If40eCLsDY_P0oIA Sep 16 02:00:22.168332 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Domain-Id: None Sep 16 02:00:22.168332 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Domain-Name: None Sep 16 02:00:22.168332 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Identity-Status: Confirmed Sep 16 02:00:22.168332 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Is-Admin-Project: True Sep 16 02:00:22.168332 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Domain-Id: default Sep 16 02:00:22.168332 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Domain-Name: Default Sep 16 02:00:22.168332 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Id: eddbb633debb4badb74f142d92baed98 Sep 16 02:00:22.168332 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Name: tempest-AttachVolumeTestJSON-1166911222 Sep 16 02:00:22.168332 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Role: member,reader Sep 16 02:00:22.168332 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Roles: member,reader Sep 16 02:00:22.169973 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/eddbb633debb4badb74f142d92baed98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/eddbb633debb4badb74f142d92baed98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_eddbb633debb4badb74f142d92baed98"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/eddbb633debb4badb74f142d92baed98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 02:00:22.169973 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant: tempest-AttachVolumeTestJSON-1166911222 Sep 16 02:00:22.169973 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant-Id: eddbb633debb4badb74f142d92baed98 Sep 16 02:00:22.169973 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1166911222 Sep 16 02:00:22.169973 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User: tempest-AttachVolumeTestJSON-1166911222-project Sep 16 02:00:22.169973 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Domain-Id: default Sep 16 02:00:22.169973 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Domain-Name: Default Sep 16 02:00:22.169973 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Id: 6fc9485505c443acb946ec66e0018f7b Sep 16 02:00:22.169973 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Name: tempest-AttachVolumeTestJSON-1166911222-project Sep 16 02:00:22.169973 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: method: > Sep 16 02:00:22.169973 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: exception: Instance df8bdee8-15d2-4b18-a2d0-8b24b43f6763 could not be found. Sep 16 02:00:22.169973 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: action_args: {'id': 'df8bdee8-15d2-4b18-a2d0-8b24b43f6763'} Sep 16 02:00:22.171571 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 02:00:22.171571 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:00:22.171571 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 02:00:22.171571 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 02:00:22.171571 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 02:00:22.171571 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 02:00:22.171571 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 02:00:22.171571 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 02:00:22.171571 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 02:00:22.171571 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 02:00:22.171571 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df8bdee8-15d2-4b18-a2d0-8b24b43f6763 could not be found. Sep 16 02:00:22.171571 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:00:22.171571 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:00:22.171571 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:00:22.171571 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:00:22.171571 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:00:22.171571 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:00:22.171571 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 02:00:22.171571 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 02:00:22.171571 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 02:00:22.173121 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 02:00:22.173121 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 02:00:22.173121 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 02:00:22.173121 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 02:00:22.173121 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 02:00:22.173121 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 02:00:22.173121 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 02:00:22.173121 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df8bdee8-15d2-4b18-a2d0-8b24b43f6763 could not be found. Sep 16 02:00:22.173121 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:00:22.173121 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:00:22.173121 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:00:22.173121 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:00:22.173121 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:00:22.173121 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:00:22.173121 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 02:00:22.173121 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 02:00:22.173121 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df8bdee8-15d2-4b18-a2d0-8b24b43f6763 could not be found. Sep 16 02:00:22.173121 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:00:22.174763 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-621b6831-91a3-425b-98e7-257d106df9cd tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Returning 404 to user: Instance df8bdee8-15d2-4b18-a2d0-8b24b43f6763 could not be found. {{(pid=120441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 02:00:22.174763 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-621b6831-91a3-425b-98e7-257d106df9cd tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 404 len: 111 microversion: 2.1 time: 0.029537 Sep 16 02:00:22.174763 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 329/644] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:00:22 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 02:00:22.180342 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-44b59786-a334-4afd-880e-b10f9a9c21b9 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '.version_select at 0x7fae329530d0>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:00:22.198564 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-44b59786-a334-4afd-880e-b10f9a9c21b9 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1302709905" status: 202 len: 0 microversion: 2.1 time: 0.022864 Sep 16 02:00:22.199117 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 316/645] 10.222.0.42 () {58 vars in 1221 bytes} [Fri Sep 16 02:00:22 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1302709905 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 02:00:22.820545 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-7d783e2d-c32a-4cfe-93c6-944c8af3f2a8 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Action: 'create', calling method: .version_select at 0x7fae32b48dc0>, body: {"keypair": {"name": "tempest-keypair-1631180497", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBANfeIp5P4t1Y4QW17ST6CJwcJvha3+LNtT4cP0CkkYcwJd3EvL8iKTM5qiRfo+ZnsQlRYBrA5iSJETR0W7ajRavJ/S2p8IyG5WQWyWUbsAhc01JZGsB1yDeOnRTtd9DQ=="}} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:00:22.836169 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.quota [None req-7d783e2d-c32a-4cfe-93c6-944c8af3f2a8 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Getting quotas for project eddbb633debb4badb74f142d92baed98. Resources: {'key_pairs'} {{(pid=120441) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 02:00:22.839806 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.quota [None req-7d783e2d-c32a-4cfe-93c6-944c8af3f2a8 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Getting quotas for user 6fc9485505c443acb946ec66e0018f7b and project eddbb633debb4badb74f142d92baed98. Resources: {'key_pairs'} {{(pid=120441) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 02:00:22.861565 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-7d783e2d-c32a-4cfe-93c6-944c8af3f2a8 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.044845 Sep 16 02:00:22.862138 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 330/646] 10.222.0.42 () {60 vars in 1159 bytes} [Fri Sep 16 02:00:22 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:00:24.061367 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-a9a06f25-679b-4629-b1b3-5b9d19e46c7e tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2101790959", "imageRef": "1546da04-912c-44c6-b4b9-34fba35e08f6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "563a693f-c940-49d3-9204-92b27430de2f"}], "security_groups": [{"name": "tempest-securitygroup--1205413745"}], "key_name": "tempest-keypair-1631180497", "user_data": "}} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:00:24.164121 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.network.neutron [None req-a9a06f25-679b-4629-b1b3-5b9d19e46c7e tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] validate_networks() for [('563a693f-c940-49d3-9204-92b27430de2f', None, None, None, None, None)] {{(pid=120440) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 02:00:24.703035 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.virt.hardware [None req-a9a06f25-679b-4629-b1b3-5b9d19e46c7e tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Flavor limits 0:0:0 {{(pid=120440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 02:00:24.703464 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.virt.hardware [None req-a9a06f25-679b-4629-b1b3-5b9d19e46c7e tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Image limits 0:0:0 {{(pid=120440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 02:00:24.703957 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.virt.hardware [None req-a9a06f25-679b-4629-b1b3-5b9d19e46c7e tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Flavor pref 0:0:0 {{(pid=120440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 02:00:24.704383 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.virt.hardware [None req-a9a06f25-679b-4629-b1b3-5b9d19e46c7e tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Image pref 0:0:0 {{(pid=120440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 02:00:24.704798 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.virt.hardware [None req-a9a06f25-679b-4629-b1b3-5b9d19e46c7e tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 02:00:24.713482 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a9a06f25-679b-4629-b1b3-5b9d19e46c7e tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:24.713963 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a9a06f25-679b-4629-b1b3-5b9d19e46c7e tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:24.714394 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a9a06f25-679b-4629-b1b3-5b9d19e46c7e tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:24.715150 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a9a06f25-679b-4629-b1b3-5b9d19e46c7e tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:24.715604 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a9a06f25-679b-4629-b1b3-5b9d19e46c7e tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:24.716053 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a9a06f25-679b-4629-b1b3-5b9d19e46c7e tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:24.733577 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.quota [None req-a9a06f25-679b-4629-b1b3-5b9d19e46c7e tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Getting quotas for project eddbb633debb4badb74f142d92baed98. Resources: {'cores', 'ram', 'instances'} {{(pid=120440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 02:00:24.737431 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.quota [None req-a9a06f25-679b-4629-b1b3-5b9d19e46c7e tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Getting quotas for user 6fc9485505c443acb946ec66e0018f7b and project eddbb633debb4badb74f142d92baed98. Resources: {'cores', 'ram', 'instances'} {{(pid=120440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 02:00:24.748947 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-a9a06f25-679b-4629-b1b3-5b9d19e46c7e tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Going to run 1 instances... {{(pid=120440) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 02:00:24.751585 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-a9a06f25-679b-4629-b1b3-5b9d19e46c7e tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: 069b7416-97ef-43ac-97f9-495b8eb0265f] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1546da04-912c-44c6-b4b9-34fba35e08f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 02:00:24.806329 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-a9a06f25-679b-4629-b1b3-5b9d19e46c7e tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.749867 Sep 16 02:00:24.807413 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 317/647] 10.222.0.42 () {60 vars in 1147 bytes} [Fri Sep 16 02:00:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 751 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 02:00:24.820562 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-f4199cf2-c087-454c-95b3-499cfc28e4a3 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:00:24.821179 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-f4199cf2-c087-454c-95b3-499cfc28e4a3 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: 069b7416-97ef-43ac-97f9-495b8eb0265f] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:00:24.879176 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-f4199cf2-c087-454c-95b3-499cfc28e4a3 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:00:24.885995 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-f4199cf2-c087-454c-95b3-499cfc28e4a3 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f" status: 200 len: 1238 microversion: 2.1 time: 0.069927 Sep 16 02:00:24.886557 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 331/648] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:00:24 2022] GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f => generated 1238 bytes in 71 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:00:25.907837 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-13c24dda-7b3f-4399-8208-eb81722b4f3d tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:00:25.908481 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-13c24dda-7b3f-4399-8208-eb81722b4f3d tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: 069b7416-97ef-43ac-97f9-495b8eb0265f] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:00:25.961732 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-13c24dda-7b3f-4399-8208-eb81722b4f3d tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:00:25.971757 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-13c24dda-7b3f-4399-8208-eb81722b4f3d tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f" status: 200 len: 1238 microversion: 2.1 time: 0.067651 Sep 16 02:00:25.972343 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 318/649] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:00:25 2022] GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f => generated 1238 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:00:26.259820 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-b9af8aee-660a-4ec5-828e-1998ef22fd58 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:00:26.260352 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-b9af8aee-660a-4ec5-828e-1998ef22fd58 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 40664bec-019b-4246-ad2b-3badd9b2e317] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:00:26.266747 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b9af8aee-660a-4ec5-828e-1998ef22fd58 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:26.267238 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b9af8aee-660a-4ec5-828e-1998ef22fd58 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:26.267672 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b9af8aee-660a-4ec5-828e-1998ef22fd58 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:26.268391 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b9af8aee-660a-4ec5-828e-1998ef22fd58 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:26.268842 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b9af8aee-660a-4ec5-828e-1998ef22fd58 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:26.269265 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b9af8aee-660a-4ec5-828e-1998ef22fd58 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:26.349352 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.objects.instance [None req-b9af8aee-660a-4ec5-828e-1998ef22fd58 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lazy-loading 'services' on Instance uuid 40664bec-019b-4246-ad2b-3badd9b2e317 {{(pid=120441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 02:00:26.419044 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-b9af8aee-660a-4ec5-828e-1998ef22fd58 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "DELETE /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317/os-volume_attachments/4b52ad91-2825-48c4-b8f0-8c04ada51edb" status: 202 len: 0 microversion: 2.1 time: 0.162967 Sep 16 02:00:26.419619 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 332/650] 10.222.0.42 () {58 vars in 1416 bytes} [Fri Sep 16 02:00:26 2022] DELETE /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317/os-volume_attachments/4b52ad91-2825-48c4-b8f0-8c04ada51edb => generated 0 bytes in 164 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 02:00:26.428664 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-8523a35f-4ab5-4dd3-aacd-4a18adc64f56 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:00:26.430927 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-8523a35f-4ab5-4dd3-aacd-4a18adc64f56 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 40664bec-019b-4246-ad2b-3badd9b2e317] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:00:26.439029 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8523a35f-4ab5-4dd3-aacd-4a18adc64f56 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:26.439520 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8523a35f-4ab5-4dd3-aacd-4a18adc64f56 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:26.439983 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8523a35f-4ab5-4dd3-aacd-4a18adc64f56 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:26.441296 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8523a35f-4ab5-4dd3-aacd-4a18adc64f56 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:26.441858 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8523a35f-4ab5-4dd3-aacd-4a18adc64f56 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:26.442519 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8523a35f-4ab5-4dd3-aacd-4a18adc64f56 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:26.474162 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-8523a35f-4ab5-4dd3-aacd-4a18adc64f56 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049424 Sep 16 02:00:26.474649 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 319/651] 10.222.0.42 () {58 vars in 1302 bytes} [Fri Sep 16 02:00:26 2022] GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:00:26.994650 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-ba8d196b-1dd2-41e6-9e69-4f9627fdfa57 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:00:26.995340 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-ba8d196b-1dd2-41e6-9e69-4f9627fdfa57 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: 069b7416-97ef-43ac-97f9-495b8eb0265f] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:00:27.063201 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-ba8d196b-1dd2-41e6-9e69-4f9627fdfa57 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:00:27.070454 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-ba8d196b-1dd2-41e6-9e69-4f9627fdfa57 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f" status: 200 len: 1238 microversion: 2.1 time: 0.080002 Sep 16 02:00:27.083876 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 333/652] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:00:26 2022] GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f => generated 1238 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:00:27.487777 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-c624e359-ce8b-4e60-ace8-4636bd873def tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:00:27.489992 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-c624e359-ce8b-4e60-ace8-4636bd873def tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 40664bec-019b-4246-ad2b-3badd9b2e317] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:00:27.496284 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c624e359-ce8b-4e60-ace8-4636bd873def tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:27.496744 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c624e359-ce8b-4e60-ace8-4636bd873def tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:27.497175 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c624e359-ce8b-4e60-ace8-4636bd873def tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:27.497862 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c624e359-ce8b-4e60-ace8-4636bd873def tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:27.498382 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c624e359-ce8b-4e60-ace8-4636bd873def tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:27.499005 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c624e359-ce8b-4e60-ace8-4636bd873def tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:27.528306 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-c624e359-ce8b-4e60-ace8-4636bd873def tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045330 Sep 16 02:00:27.528855 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 320/653] 10.222.0.42 () {58 vars in 1302 bytes} [Fri Sep 16 02:00:27 2022] GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 02:00:27.620116 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-35b26ce0-9964-4909-81d6-4dd85dd4dd29 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:00:27.620712 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-35b26ce0-9964-4909-81d6-4dd85dd4dd29 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 40664bec-019b-4246-ad2b-3badd9b2e317] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:00:27.629519 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-35b26ce0-9964-4909-81d6-4dd85dd4dd29 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:27.630332 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-35b26ce0-9964-4909-81d6-4dd85dd4dd29 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:27.630900 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-35b26ce0-9964-4909-81d6-4dd85dd4dd29 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:27.631783 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-35b26ce0-9964-4909-81d6-4dd85dd4dd29 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:27.632292 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-35b26ce0-9964-4909-81d6-4dd85dd4dd29 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:27.632962 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-35b26ce0-9964-4909-81d6-4dd85dd4dd29 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:27.664124 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-35b26ce0-9964-4909-81d6-4dd85dd4dd29 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 40664bec-019b-4246-ad2b-3badd9b2e317] Going to try to terminate instance {{(pid=120441) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 02:00:27.755217 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-35b26ce0-9964-4909-81d6-4dd85dd4dd29 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "DELETE /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317" status: 204 len: 0 microversion: 2.1 time: 0.139557 Sep 16 02:00:27.756633 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 334/654] 10.222.0.42 () {58 vars in 1239 bytes} [Fri Sep 16 02:00:27 2022] DELETE /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317 => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 02:00:27.766730 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-a3980e4a-ccaa-49e3-917f-7d4f2634a581 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:00:27.767338 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-a3980e4a-ccaa-49e3-917f-7d4f2634a581 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 40664bec-019b-4246-ad2b-3badd9b2e317] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:00:27.773228 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a3980e4a-ccaa-49e3-917f-7d4f2634a581 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:27.773955 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a3980e4a-ccaa-49e3-917f-7d4f2634a581 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:27.774125 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a3980e4a-ccaa-49e3-917f-7d4f2634a581 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:27.774807 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a3980e4a-ccaa-49e3-917f-7d4f2634a581 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:27.775257 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a3980e4a-ccaa-49e3-917f-7d4f2634a581 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:27.775674 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a3980e4a-ccaa-49e3-917f-7d4f2634a581 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:27.922667 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-a3980e4a-ccaa-49e3-917f-7d4f2634a581 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:00:27.930895 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-a3980e4a-ccaa-49e3-917f-7d4f2634a581 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317" status: 200 len: 1688 microversion: 2.1 time: 0.169187 Sep 16 02:00:27.931466 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 321/655] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:00:27 2022] GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317 => generated 1688 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 02:00:28.093865 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-fdfff922-2296-42d1-bb9a-1cc2106ced38 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:00:28.094567 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-fdfff922-2296-42d1-bb9a-1cc2106ced38 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: 069b7416-97ef-43ac-97f9-495b8eb0265f] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:00:28.150432 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-fdfff922-2296-42d1-bb9a-1cc2106ced38 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:00:28.157514 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-fdfff922-2296-42d1-bb9a-1cc2106ced38 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f" status: 200 len: 1238 microversion: 2.1 time: 0.068015 Sep 16 02:00:28.158325 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 335/656] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:00:28 2022] GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f => generated 1238 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:00:28.954842 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-91deadf1-366a-4dc3-a3d3-c375974ca397 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:00:28.955514 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-91deadf1-366a-4dc3-a3d3-c375974ca397 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 40664bec-019b-4246-ad2b-3badd9b2e317] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:00:28.962454 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-91deadf1-366a-4dc3-a3d3-c375974ca397 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:28.962942 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-91deadf1-366a-4dc3-a3d3-c375974ca397 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:28.963333 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-91deadf1-366a-4dc3-a3d3-c375974ca397 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:28.964058 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-91deadf1-366a-4dc3-a3d3-c375974ca397 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:28.964510 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-91deadf1-366a-4dc3-a3d3-c375974ca397 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:28.964937 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-91deadf1-366a-4dc3-a3d3-c375974ca397 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:29.092996 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-91deadf1-366a-4dc3-a3d3-c375974ca397 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:00:29.100722 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-91deadf1-366a-4dc3-a3d3-c375974ca397 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317" status: 200 len: 1688 microversion: 2.1 time: 0.149778 Sep 16 02:00:29.101300 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 322/657] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:00:28 2022] GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317 => generated 1688 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:00:29.180194 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-4a8e964f-fa4f-403a-b709-3b8e44d71e84 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:00:29.180802 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-4a8e964f-fa4f-403a-b709-3b8e44d71e84 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: 069b7416-97ef-43ac-97f9-495b8eb0265f] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:00:29.188050 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4a8e964f-fa4f-403a-b709-3b8e44d71e84 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:29.188530 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4a8e964f-fa4f-403a-b709-3b8e44d71e84 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:29.188971 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4a8e964f-fa4f-403a-b709-3b8e44d71e84 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:29.189658 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4a8e964f-fa4f-403a-b709-3b8e44d71e84 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:29.190112 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4a8e964f-fa4f-403a-b709-3b8e44d71e84 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:29.190535 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4a8e964f-fa4f-403a-b709-3b8e44d71e84 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:29.255773 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-4a8e964f-fa4f-403a-b709-3b8e44d71e84 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:00:29.263391 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-4a8e964f-fa4f-403a-b709-3b8e44d71e84 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f" status: 200 len: 1242 microversion: 2.1 time: 0.087095 Sep 16 02:00:29.264513 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 336/658] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:00:29 2022] GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f => generated 1242 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:00:30.125609 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-189450d7-e49c-4063-a2d8-48bdc91afccd tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:00:30.126329 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-189450d7-e49c-4063-a2d8-48bdc91afccd tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 40664bec-019b-4246-ad2b-3badd9b2e317] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:00:30.133287 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-189450d7-e49c-4063-a2d8-48bdc91afccd tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:30.133768 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-189450d7-e49c-4063-a2d8-48bdc91afccd tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:30.134204 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-189450d7-e49c-4063-a2d8-48bdc91afccd tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:30.134889 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-189450d7-e49c-4063-a2d8-48bdc91afccd tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:30.135342 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-189450d7-e49c-4063-a2d8-48bdc91afccd tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:30.135765 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-189450d7-e49c-4063-a2d8-48bdc91afccd tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:30.271712 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-189450d7-e49c-4063-a2d8-48bdc91afccd tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:00:30.279442 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-189450d7-e49c-4063-a2d8-48bdc91afccd tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317" status: 200 len: 1688 microversion: 2.1 time: 0.159329 Sep 16 02:00:30.282875 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 323/659] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:00:30 2022] GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317 => generated 1688 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 02:00:30.286556 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-2a9db9ed-8278-456d-a8db-3f8d2456d457 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:00:30.287175 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-2a9db9ed-8278-456d-a8db-3f8d2456d457 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: 069b7416-97ef-43ac-97f9-495b8eb0265f] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:00:30.293531 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2a9db9ed-8278-456d-a8db-3f8d2456d457 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:30.294017 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2a9db9ed-8278-456d-a8db-3f8d2456d457 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:30.294454 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2a9db9ed-8278-456d-a8db-3f8d2456d457 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:30.295218 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2a9db9ed-8278-456d-a8db-3f8d2456d457 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:30.295671 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2a9db9ed-8278-456d-a8db-3f8d2456d457 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:30.296280 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2a9db9ed-8278-456d-a8db-3f8d2456d457 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:30.356512 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-2a9db9ed-8278-456d-a8db-3f8d2456d457 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:00:30.364099 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-2a9db9ed-8278-456d-a8db-3f8d2456d457 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f" status: 200 len: 1242 microversion: 2.1 time: 0.081433 Sep 16 02:00:30.364720 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 337/660] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:00:30 2022] GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f => generated 1242 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:00:31.303487 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-6b799e2c-da14-458c-8072-a7860e75547d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:00:31.304049 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-6b799e2c-da14-458c-8072-a7860e75547d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 40664bec-019b-4246-ad2b-3badd9b2e317] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:00:31.311676 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6b799e2c-da14-458c-8072-a7860e75547d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:31.312193 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6b799e2c-da14-458c-8072-a7860e75547d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:31.312632 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6b799e2c-da14-458c-8072-a7860e75547d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:31.313315 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6b799e2c-da14-458c-8072-a7860e75547d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:31.313765 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6b799e2c-da14-458c-8072-a7860e75547d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:31.314214 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6b799e2c-da14-458c-8072-a7860e75547d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:31.386760 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-dbf11a68-5672-480d-bc0a-e80d4f540dfe tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:00:31.387377 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-dbf11a68-5672-480d-bc0a-e80d4f540dfe tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: 069b7416-97ef-43ac-97f9-495b8eb0265f] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:00:31.395872 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-dbf11a68-5672-480d-bc0a-e80d4f540dfe tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:31.396605 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-dbf11a68-5672-480d-bc0a-e80d4f540dfe tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:31.397225 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-dbf11a68-5672-480d-bc0a-e80d4f540dfe tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:31.398521 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-dbf11a68-5672-480d-bc0a-e80d4f540dfe tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:31.399465 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-dbf11a68-5672-480d-bc0a-e80d4f540dfe tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:31.399780 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-dbf11a68-5672-480d-bc0a-e80d4f540dfe tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:31.466181 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-6b799e2c-da14-458c-8072-a7860e75547d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:00:31.474497 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-6b799e2c-da14-458c-8072-a7860e75547d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317" status: 200 len: 1688 microversion: 2.1 time: 0.175370 Sep 16 02:00:31.475080 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 324/661] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:00:31 2022] GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317 => generated 1688 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:00:31.489181 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-dbf11a68-5672-480d-bc0a-e80d4f540dfe tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:00:31.498687 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-dbf11a68-5672-480d-bc0a-e80d4f540dfe tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f" status: 200 len: 1290 microversion: 2.1 time: 0.115528 Sep 16 02:00:31.499269 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 338/662] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:00:31 2022] GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f => generated 1290 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:00:32.498132 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-a29d5b8f-41f4-484d-8b0d-635d1d064702 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:00:32.498859 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-a29d5b8f-41f4-484d-8b0d-635d1d064702 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 40664bec-019b-4246-ad2b-3badd9b2e317] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:00:32.505700 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a29d5b8f-41f4-484d-8b0d-635d1d064702 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:32.510255 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a29d5b8f-41f4-484d-8b0d-635d1d064702 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:32.510925 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a29d5b8f-41f4-484d-8b0d-635d1d064702 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:32.511694 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a29d5b8f-41f4-484d-8b0d-635d1d064702 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:32.512235 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a29d5b8f-41f4-484d-8b0d-635d1d064702 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:32.512884 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a29d5b8f-41f4-484d-8b0d-635d1d064702 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:32.523919 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-cbc1ccf1-4556-4eae-b160-e3c72c4baf13 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:00:32.524599 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-cbc1ccf1-4556-4eae-b160-e3c72c4baf13 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: 069b7416-97ef-43ac-97f9-495b8eb0265f] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:00:32.537793 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-cbc1ccf1-4556-4eae-b160-e3c72c4baf13 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:32.538748 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-cbc1ccf1-4556-4eae-b160-e3c72c4baf13 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:32.539369 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-cbc1ccf1-4556-4eae-b160-e3c72c4baf13 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:32.540330 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-cbc1ccf1-4556-4eae-b160-e3c72c4baf13 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:32.540996 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-cbc1ccf1-4556-4eae-b160-e3c72c4baf13 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:32.541716 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-cbc1ccf1-4556-4eae-b160-e3c72c4baf13 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:32.618303 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-a29d5b8f-41f4-484d-8b0d-635d1d064702 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:00:32.629038 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-a29d5b8f-41f4-484d-8b0d-635d1d064702 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317" status: 200 len: 1621 microversion: 2.1 time: 0.135062 Sep 16 02:00:32.645777 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 325/663] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:00:32 2022] GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317 => generated 1621 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:00:32.652235 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [req-5cda0fe5-e930-498e-80a9-d0758650a6d7 req-556e36a1-50b4-48f1-a870-4cdf07230161 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "40664bec-019b-4246-ad2b-3badd9b2e317", "name": "network-vif-deleted", "tag": "1f6c616e-c78b-414c-883d-8d50a28be1bc"}]} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:00:32.664217 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-cbc1ccf1-4556-4eae-b160-e3c72c4baf13 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:00:32.667403 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-5cda0fe5-e930-498e-80a9-d0758650a6d7 req-556e36a1-50b4-48f1-a870-4cdf07230161 service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:32.668041 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-5cda0fe5-e930-498e-80a9-d0758650a6d7 req-556e36a1-50b4-48f1-a870-4cdf07230161 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:32.668487 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-5cda0fe5-e930-498e-80a9-d0758650a6d7 req-556e36a1-50b4-48f1-a870-4cdf07230161 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:32.677724 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-cbc1ccf1-4556-4eae-b160-e3c72c4baf13 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f" status: 200 len: 1296 microversion: 2.1 time: 0.157408 Sep 16 02:00:32.679327 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 339/664] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:00:32 2022] GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f => generated 1296 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:00:32.704198 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.compute.server_external_events [req-5cda0fe5-e930-498e-80a9-d0758650a6d7 req-556e36a1-50b4-48f1-a870-4cdf07230161 service nova] Creating event network-vif-deleted:1f6c616e-c78b-414c-883d-8d50a28be1bc for instance 40664bec-019b-4246-ad2b-3badd9b2e317 on hv-cinder-84914 Sep 16 02:00:32.710332 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [req-5cda0fe5-e930-498e-80a9-d0758650a6d7 req-556e36a1-50b4-48f1-a870-4cdf07230161 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062610 Sep 16 02:00:32.711265 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 326/665] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:00:32 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 65 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:00:33.652902 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-794cdf30-9ef0-4b52-8a0f-f184b559dc1d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:00:33.653581 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-794cdf30-9ef0-4b52-8a0f-f184b559dc1d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 40664bec-019b-4246-ad2b-3badd9b2e317] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:00:33.663394 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-794cdf30-9ef0-4b52-8a0f-f184b559dc1d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:33.664032 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-794cdf30-9ef0-4b52-8a0f-f184b559dc1d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:33.664705 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-794cdf30-9ef0-4b52-8a0f-f184b559dc1d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:33.665860 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-794cdf30-9ef0-4b52-8a0f-f184b559dc1d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:33.666465 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-794cdf30-9ef0-4b52-8a0f-f184b559dc1d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:33.668292 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-794cdf30-9ef0-4b52-8a0f-f184b559dc1d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:33.691010 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.wsgi [None req-794cdf30-9ef0-4b52-8a0f-f184b559dc1d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] HTTP exception thrown: Instance 40664bec-019b-4246-ad2b-3badd9b2e317 could not be found. Sep 16 02:00:33.693048 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-794cdf30-9ef0-4b52-8a0f-f184b559dc1d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Request method failure captured: Sep 16 02:00:33.693048 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: request: GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317 HTTP/1.1 Sep 16 02:00:33.693048 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Accept: application/json Sep 16 02:00:33.693048 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Accept-Encoding: identity Sep 16 02:00:33.693048 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Connection: close Sep 16 02:00:33.693048 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Content-Length: 0 Sep 16 02:00:33.693048 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Content-Type: application/json Sep 16 02:00:33.693048 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Host: 10.222.0.42 Sep 16 02:00:33.693048 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Openstack-System-Scope: None Sep 16 02:00:33.693048 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: User-Agent: python-urllib3/1.26.12 Sep 16 02:00:33.693048 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Auth-Token: gAAAAABjI9c-Il8-3hF9Li-IW6ki3rCRxsddmEYj-CEjGwEumw94mpgkrl63sWplgEqXoUz3fiC-3x44O1RRD4kaA9W4JY76zYcpF4adB0c8IXHbjAFOjhvg_wlD1HQTgu9jYX9bvxA4OlQVlK-DbI0GW9oqAmi3IZAroqSCl3VtQWlC8iqMZFo Sep 16 02:00:33.693048 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Domain-Id: None Sep 16 02:00:33.693048 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Domain-Name: None Sep 16 02:00:33.693048 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Identity-Status: Confirmed Sep 16 02:00:33.693048 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Is-Admin-Project: True Sep 16 02:00:33.693048 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Domain-Id: default Sep 16 02:00:33.693048 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Domain-Name: Default Sep 16 02:00:33.693048 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Id: 57aaf234892543698d91303961f14abd Sep 16 02:00:33.693048 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1497504670 Sep 16 02:00:33.693048 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Role: member,reader Sep 16 02:00:33.693048 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Roles: member,reader Sep 16 02:00:33.694402 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/57aaf234892543698d91303961f14abd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/57aaf234892543698d91303961f14abd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_57aaf234892543698d91303961f14abd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/57aaf234892543698d91303961f14abd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 02:00:33.694402 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1497504670 Sep 16 02:00:33.694402 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant-Id: 57aaf234892543698d91303961f14abd Sep 16 02:00:33.694402 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1497504670 Sep 16 02:00:33.694402 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User: tempest-ServerRescueNegativeTestJSON-1497504670-project Sep 16 02:00:33.694402 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Domain-Id: default Sep 16 02:00:33.694402 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Domain-Name: Default Sep 16 02:00:33.694402 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Id: 7eb6ab0644bf4fa59d7bba232d6ccb3c Sep 16 02:00:33.694402 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1497504670-project Sep 16 02:00:33.694402 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: method: > Sep 16 02:00:33.694402 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: exception: Instance 40664bec-019b-4246-ad2b-3badd9b2e317 could not be found. Sep 16 02:00:33.694402 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: action_args: {'id': '40664bec-019b-4246-ad2b-3badd9b2e317'} Sep 16 02:00:33.695158 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 02:00:33.695158 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:00:33.695158 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 02:00:33.695158 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 02:00:33.695158 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 02:00:33.695158 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 02:00:33.695158 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 02:00:33.695158 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 02:00:33.695158 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 02:00:33.695158 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 02:00:33.695158 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 40664bec-019b-4246-ad2b-3badd9b2e317 could not be found. Sep 16 02:00:33.695158 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:00:33.695158 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:00:33.695158 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:00:33.695158 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:00:33.695158 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:00:33.695158 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:00:33.695158 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 02:00:33.695158 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 02:00:33.695158 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 02:00:33.696344 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 02:00:33.696344 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 02:00:33.696344 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 02:00:33.696344 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 02:00:33.696344 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 02:00:33.696344 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 02:00:33.696344 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 02:00:33.696344 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 40664bec-019b-4246-ad2b-3badd9b2e317 could not be found. Sep 16 02:00:33.696344 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:00:33.696344 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:00:33.696344 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:00:33.696344 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:00:33.696344 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:00:33.696344 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:00:33.696344 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 02:00:33.696344 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 02:00:33.696344 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 40664bec-019b-4246-ad2b-3badd9b2e317 could not be found. Sep 16 02:00:33.696344 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:00:33.697377 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-794cdf30-9ef0-4b52-8a0f-f184b559dc1d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Returning 404 to user: Instance 40664bec-019b-4246-ad2b-3badd9b2e317 could not be found. {{(pid=120441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 02:00:33.697377 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-794cdf30-9ef0-4b52-8a0f-f184b559dc1d tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317" status: 404 len: 111 microversion: 2.1 time: 0.045762 Sep 16 02:00:33.697377 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 340/666] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:00:33 2022] GET /compute/v2.1/servers/40664bec-019b-4246-ad2b-3badd9b2e317 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 02:00:33.704977 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-79af8ff6-1c89-4d8c-bedd-9ec3f435b457 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:00:33.705692 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-79af8ff6-1c89-4d8c-bedd-9ec3f435b457 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: 069b7416-97ef-43ac-97f9-495b8eb0265f] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:00:33.712384 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-79af8ff6-1c89-4d8c-bedd-9ec3f435b457 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:33.713009 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-56d8084d-8f7c-47ca-9c87-421597d3ad18 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '.version_select at 0x7fae36350820>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:00:33.713359 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-79af8ff6-1c89-4d8c-bedd-9ec3f435b457 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:33.714003 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-79af8ff6-1c89-4d8c-bedd-9ec3f435b457 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:33.714960 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-79af8ff6-1c89-4d8c-bedd-9ec3f435b457 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:33.715630 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-79af8ff6-1c89-4d8c-bedd-9ec3f435b457 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:33.716293 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-79af8ff6-1c89-4d8c-bedd-9ec3f435b457 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:33.739364 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-56d8084d-8f7c-47ca-9c87-421597d3ad18 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1164743971" status: 202 len: 0 microversion: 2.1 time: 0.028831 Sep 16 02:00:33.740317 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 341/667] 10.222.0.42 () {58 vars in 1221 bytes} [Fri Sep 16 02:00:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1164743971 => generated 0 bytes in 32 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 02:00:33.946435 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-79af8ff6-1c89-4d8c-bedd-9ec3f435b457 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:00:33.958513 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-79af8ff6-1c89-4d8c-bedd-9ec3f435b457 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f" status: 200 len: 1364 microversion: 2.1 time: 0.258019 Sep 16 02:00:33.959647 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 327/668] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:00:33 2022] GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f => generated 1364 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:00:34.728803 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [req-a3791e34-d3d4-405a-bbd2-2c38ce8092f7 req-ad47a60b-6a13-482e-9f7e-a9cf2a47d1d8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "069b7416-97ef-43ac-97f9-495b8eb0265f", "tag": "910a23a7-03f3-4a82-b8d8-4b238685b022"}]} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:00:34.742186 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-a3791e34-d3d4-405a-bbd2-2c38ce8092f7 req-ad47a60b-6a13-482e-9f7e-a9cf2a47d1d8 service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:34.742778 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-a3791e34-d3d4-405a-bbd2-2c38ce8092f7 req-ad47a60b-6a13-482e-9f7e-a9cf2a47d1d8 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:34.743339 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-a3791e34-d3d4-405a-bbd2-2c38ce8092f7 req-ad47a60b-6a13-482e-9f7e-a9cf2a47d1d8 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:34.756096 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.compute.server_external_events [req-a3791e34-d3d4-405a-bbd2-2c38ce8092f7 req-ad47a60b-6a13-482e-9f7e-a9cf2a47d1d8 service nova] Creating event network-changed:910a23a7-03f3-4a82-b8d8-4b238685b022 for instance 069b7416-97ef-43ac-97f9-495b8eb0265f on hv-cinder-84914 Sep 16 02:00:34.760909 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [req-a3791e34-d3d4-405a-bbd2-2c38ce8092f7 req-ad47a60b-6a13-482e-9f7e-a9cf2a47d1d8 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037610 Sep 16 02:00:34.761537 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 342/669] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:00:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:00:34.985560 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-48aaf77b-1554-4d26-90c8-3e7930165de9 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:00:34.986171 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-48aaf77b-1554-4d26-90c8-3e7930165de9 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: 069b7416-97ef-43ac-97f9-495b8eb0265f] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:00:34.988576 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell0:SELECT=2 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:00:34.994565 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-48aaf77b-1554-4d26-90c8-3e7930165de9 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:34.995072 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-48aaf77b-1554-4d26-90c8-3e7930165de9 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:34.995489 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-48aaf77b-1554-4d26-90c8-3e7930165de9 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:34.996893 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-48aaf77b-1554-4d26-90c8-3e7930165de9 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:34.996893 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-48aaf77b-1554-4d26-90c8-3e7930165de9 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:34.997218 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-48aaf77b-1554-4d26-90c8-3e7930165de9 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:35.131539 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-48aaf77b-1554-4d26-90c8-3e7930165de9 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:00:35.139962 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-48aaf77b-1554-4d26-90c8-3e7930165de9 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f" status: 200 len: 1364 microversion: 2.1 time: 0.159205 Sep 16 02:00:35.140533 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 328/670] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:00:34 2022] GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f => generated 1364 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:00:36.164393 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-ba22fb98-2af0-4fa1-bb32-2a48ee0e057c tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:00:36.165090 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-ba22fb98-2af0-4fa1-bb32-2a48ee0e057c tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: 069b7416-97ef-43ac-97f9-495b8eb0265f] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:00:36.172229 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ba22fb98-2af0-4fa1-bb32-2a48ee0e057c tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:36.172718 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ba22fb98-2af0-4fa1-bb32-2a48ee0e057c tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:36.173192 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ba22fb98-2af0-4fa1-bb32-2a48ee0e057c tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:36.173880 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ba22fb98-2af0-4fa1-bb32-2a48ee0e057c tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:36.174337 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ba22fb98-2af0-4fa1-bb32-2a48ee0e057c tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:36.174769 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ba22fb98-2af0-4fa1-bb32-2a48ee0e057c tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:36.312088 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-ba22fb98-2af0-4fa1-bb32-2a48ee0e057c tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:00:36.320100 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-ba22fb98-2af0-4fa1-bb32-2a48ee0e057c tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f" status: 200 len: 1364 microversion: 2.1 time: 0.160329 Sep 16 02:00:36.320716 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 343/671] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:00:36 2022] GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:00:36.832220 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-05f80da0-3e66-4df7-8746-407d882666bf tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:00:36.832728 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-05f80da0-3e66-4df7-8746-407d882666bf tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:00:36.834760 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell0:SELECT=8 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:00:36.843327 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-05f80da0-3e66-4df7-8746-407d882666bf tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:36.843926 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-05f80da0-3e66-4df7-8746-407d882666bf tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:36.844449 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-05f80da0-3e66-4df7-8746-407d882666bf tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:36.845471 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-05f80da0-3e66-4df7-8746-407d882666bf tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:36.846082 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-05f80da0-3e66-4df7-8746-407d882666bf tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:36.846515 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-05f80da0-3e66-4df7-8746-407d882666bf tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:36.876804 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-05f80da0-3e66-4df7-8746-407d882666bf tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Going to try to terminate instance {{(pid=120440) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 02:00:36.974097 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-05f80da0-3e66-4df7-8746-407d882666bf tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "DELETE /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 204 len: 0 microversion: 2.1 time: 0.145512 Sep 16 02:00:36.974931 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 329/672] 10.222.0.42 () {58 vars in 1239 bytes} [Fri Sep 16 02:00:36 2022] DELETE /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 02:00:36.983193 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-1e28e4f5-ec49-4ac4-80fa-c1f1a14da0f1 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:00:36.983815 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-1e28e4f5-ec49-4ac4-80fa-c1f1a14da0f1 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:00:36.989794 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1e28e4f5-ec49-4ac4-80fa-c1f1a14da0f1 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:36.990287 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1e28e4f5-ec49-4ac4-80fa-c1f1a14da0f1 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:36.990722 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1e28e4f5-ec49-4ac4-80fa-c1f1a14da0f1 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:36.991414 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1e28e4f5-ec49-4ac4-80fa-c1f1a14da0f1 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:36.991865 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1e28e4f5-ec49-4ac4-80fa-c1f1a14da0f1 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:36.992339 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1e28e4f5-ec49-4ac4-80fa-c1f1a14da0f1 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:37.126364 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-1e28e4f5-ec49-4ac4-80fa-c1f1a14da0f1 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:00:37.134361 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-1e28e4f5-ec49-4ac4-80fa-c1f1a14da0f1 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1506 microversion: 2.1 time: 0.155526 Sep 16 02:00:37.134928 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 344/673] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:00:36 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1506 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:00:37.343802 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-97240719-f6a2-4cda-a697-99ee292d22ec tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:00:37.344439 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-97240719-f6a2-4cda-a697-99ee292d22ec tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: 069b7416-97ef-43ac-97f9-495b8eb0265f] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:00:37.350768 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-97240719-f6a2-4cda-a697-99ee292d22ec tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:37.351336 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-97240719-f6a2-4cda-a697-99ee292d22ec tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:37.351779 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-97240719-f6a2-4cda-a697-99ee292d22ec tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:37.352525 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-97240719-f6a2-4cda-a697-99ee292d22ec tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:37.353130 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-97240719-f6a2-4cda-a697-99ee292d22ec tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:37.353610 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-97240719-f6a2-4cda-a697-99ee292d22ec tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:37.358855 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:00:37.492991 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-97240719-f6a2-4cda-a697-99ee292d22ec tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:00:37.501823 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-97240719-f6a2-4cda-a697-99ee292d22ec tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f" status: 200 len: 1364 microversion: 2.1 time: 0.162720 Sep 16 02:00:37.502645 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 330/674] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:00:37 2022] GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:00:38.158646 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-b82ca80e-8d53-4741-92a3-7015b51b29a3 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:00:38.159279 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-b82ca80e-8d53-4741-92a3-7015b51b29a3 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:00:38.161870 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell0:SELECT=10 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:00:38.168130 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b82ca80e-8d53-4741-92a3-7015b51b29a3 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:38.168270 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b82ca80e-8d53-4741-92a3-7015b51b29a3 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:38.168857 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b82ca80e-8d53-4741-92a3-7015b51b29a3 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:38.169559 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b82ca80e-8d53-4741-92a3-7015b51b29a3 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:38.170047 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b82ca80e-8d53-4741-92a3-7015b51b29a3 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:38.170676 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b82ca80e-8d53-4741-92a3-7015b51b29a3 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:38.356631 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-b82ca80e-8d53-4741-92a3-7015b51b29a3 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:00:38.365053 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-b82ca80e-8d53-4741-92a3-7015b51b29a3 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1506 microversion: 2.1 time: 0.210871 Sep 16 02:00:38.365621 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 345/675] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:00:38 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1506 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:00:38.527715 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-a986cc86-9424-4ac6-8ba4-6554549978df tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:00:38.528353 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-a986cc86-9424-4ac6-8ba4-6554549978df tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: 069b7416-97ef-43ac-97f9-495b8eb0265f] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:00:38.536349 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a986cc86-9424-4ac6-8ba4-6554549978df tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:38.537007 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a986cc86-9424-4ac6-8ba4-6554549978df tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:38.537531 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a986cc86-9424-4ac6-8ba4-6554549978df tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:38.538531 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a986cc86-9424-4ac6-8ba4-6554549978df tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:38.539232 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a986cc86-9424-4ac6-8ba4-6554549978df tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:38.539841 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a986cc86-9424-4ac6-8ba4-6554549978df tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:38.679991 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-a986cc86-9424-4ac6-8ba4-6554549978df tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:00:38.688469 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-a986cc86-9424-4ac6-8ba4-6554549978df tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f" status: 200 len: 1364 microversion: 2.1 time: 0.165626 Sep 16 02:00:38.689112 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 331/676] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:00:38 2022] GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:00:39.141913 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [req-23347a36-4cfc-4819-8661-4790bb823e55 req-2e9f150d-35eb-4038-8a5f-cda8fea77b95 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7", "name": "network-vif-deleted", "tag": "f93c0228-6dda-49f9-ac21-d2d3362262fa"}]} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:00:39.155399 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-23347a36-4cfc-4819-8661-4790bb823e55 req-2e9f150d-35eb-4038-8a5f-cda8fea77b95 service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:39.156109 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-23347a36-4cfc-4819-8661-4790bb823e55 req-2e9f150d-35eb-4038-8a5f-cda8fea77b95 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:39.156609 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-23347a36-4cfc-4819-8661-4790bb823e55 req-2e9f150d-35eb-4038-8a5f-cda8fea77b95 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:39.169038 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.compute.server_external_events [req-23347a36-4cfc-4819-8661-4790bb823e55 req-2e9f150d-35eb-4038-8a5f-cda8fea77b95 service nova] Creating event network-vif-deleted:f93c0228-6dda-49f9-ac21-d2d3362262fa for instance 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 on hv-cinder-84914 Sep 16 02:00:39.175765 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [req-23347a36-4cfc-4819-8661-4790bb823e55 req-2e9f150d-35eb-4038-8a5f-cda8fea77b95 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037771 Sep 16 02:00:39.176680 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 346/677] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:00:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:00:39.387412 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-6ed6af9e-7795-486e-bfb4-e82f1db04a6b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:00:39.389285 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-6ed6af9e-7795-486e-bfb4-e82f1db04a6b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:00:39.395097 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6ed6af9e-7795-486e-bfb4-e82f1db04a6b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:39.395763 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6ed6af9e-7795-486e-bfb4-e82f1db04a6b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:39.396178 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6ed6af9e-7795-486e-bfb4-e82f1db04a6b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:39.396941 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6ed6af9e-7795-486e-bfb4-e82f1db04a6b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:39.397403 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6ed6af9e-7795-486e-bfb4-e82f1db04a6b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:39.397896 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6ed6af9e-7795-486e-bfb4-e82f1db04a6b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:39.437703 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6ed6af9e-7795-486e-bfb4-e82f1db04a6b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:39.438216 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6ed6af9e-7795-486e-bfb4-e82f1db04a6b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:39.438851 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6ed6af9e-7795-486e-bfb4-e82f1db04a6b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:39.439307 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.objects.instance [None req-6ed6af9e-7795-486e-bfb4-e82f1db04a6b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lazy-loading 'fault' on Instance uuid 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 {{(pid=120440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 02:00:39.488076 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-6ed6af9e-7795-486e-bfb4-e82f1db04a6b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:00:39.496486 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-6ed6af9e-7795-486e-bfb4-e82f1db04a6b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 200 len: 1311 microversion: 2.1 time: 0.112886 Sep 16 02:00:39.497143 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 332/678] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:00:39 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 1311 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:00:39.712330 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-dd711d0e-4bac-481e-a1c2-045657d71212 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:00:39.712934 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-dd711d0e-4bac-481e-a1c2-045657d71212 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: 069b7416-97ef-43ac-97f9-495b8eb0265f] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:00:39.719114 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-dd711d0e-4bac-481e-a1c2-045657d71212 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:39.719653 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-dd711d0e-4bac-481e-a1c2-045657d71212 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:39.720090 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-dd711d0e-4bac-481e-a1c2-045657d71212 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:39.720798 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-dd711d0e-4bac-481e-a1c2-045657d71212 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:39.721254 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-dd711d0e-4bac-481e-a1c2-045657d71212 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:39.721684 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-dd711d0e-4bac-481e-a1c2-045657d71212 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:39.862936 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-dd711d0e-4bac-481e-a1c2-045657d71212 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:00:39.867327 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:00:39.873699 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-dd711d0e-4bac-481e-a1c2-045657d71212 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f" status: 200 len: 1364 microversion: 2.1 time: 0.165664 Sep 16 02:00:39.874439 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 347/679] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:00:39 2022] GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:00:40.523691 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-69685276-8405-4b09-88fc-4040dabe7e4b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:00:40.524409 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-69685276-8405-4b09-88fc-4040dabe7e4b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:00:40.533278 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-69685276-8405-4b09-88fc-4040dabe7e4b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:40.533769 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-69685276-8405-4b09-88fc-4040dabe7e4b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:40.534205 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-69685276-8405-4b09-88fc-4040dabe7e4b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:40.534893 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-69685276-8405-4b09-88fc-4040dabe7e4b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:40.535346 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-69685276-8405-4b09-88fc-4040dabe7e4b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:40.535766 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-69685276-8405-4b09-88fc-4040dabe7e4b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:40.551294 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.wsgi [None req-69685276-8405-4b09-88fc-4040dabe7e4b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] HTTP exception thrown: Instance 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 could not be found. Sep 16 02:00:40.553343 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-69685276-8405-4b09-88fc-4040dabe7e4b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Request method failure captured: Sep 16 02:00:40.553343 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: request: GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 HTTP/1.1 Sep 16 02:00:40.553343 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept: application/json Sep 16 02:00:40.553343 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept-Encoding: identity Sep 16 02:00:40.553343 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Connection: close Sep 16 02:00:40.553343 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Length: 0 Sep 16 02:00:40.553343 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Type: application/json Sep 16 02:00:40.553343 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Host: 10.222.0.42 Sep 16 02:00:40.553343 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Openstack-System-Scope: None Sep 16 02:00:40.553343 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: User-Agent: python-urllib3/1.26.12 Sep 16 02:00:40.553343 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Auth-Token: gAAAAABjI9c-Il8-3hF9Li-IW6ki3rCRxsddmEYj-CEjGwEumw94mpgkrl63sWplgEqXoUz3fiC-3x44O1RRD4kaA9W4JY76zYcpF4adB0c8IXHbjAFOjhvg_wlD1HQTgu9jYX9bvxA4OlQVlK-DbI0GW9oqAmi3IZAroqSCl3VtQWlC8iqMZFo Sep 16 02:00:40.553343 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Id: None Sep 16 02:00:40.553343 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Name: None Sep 16 02:00:40.553343 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Identity-Status: Confirmed Sep 16 02:00:40.553343 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Is-Admin-Project: True Sep 16 02:00:40.553343 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Id: default Sep 16 02:00:40.553343 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Name: Default Sep 16 02:00:40.553343 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Id: 57aaf234892543698d91303961f14abd Sep 16 02:00:40.553343 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1497504670 Sep 16 02:00:40.553343 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Role: member,reader Sep 16 02:00:40.553343 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Roles: member,reader Sep 16 02:00:40.554848 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/57aaf234892543698d91303961f14abd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/57aaf234892543698d91303961f14abd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_57aaf234892543698d91303961f14abd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/57aaf234892543698d91303961f14abd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 02:00:40.554848 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1497504670 Sep 16 02:00:40.554848 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Id: 57aaf234892543698d91303961f14abd Sep 16 02:00:40.554848 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1497504670 Sep 16 02:00:40.554848 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User: tempest-ServerRescueNegativeTestJSON-1497504670-project Sep 16 02:00:40.554848 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Id: default Sep 16 02:00:40.554848 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Name: Default Sep 16 02:00:40.554848 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Id: 7eb6ab0644bf4fa59d7bba232d6ccb3c Sep 16 02:00:40.554848 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1497504670-project Sep 16 02:00:40.554848 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: method: > Sep 16 02:00:40.554848 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: exception: Instance 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 could not be found. Sep 16 02:00:40.554848 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: action_args: {'id': '7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7'} Sep 16 02:00:40.555710 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 02:00:40.555710 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:00:40.555710 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 02:00:40.555710 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 02:00:40.555710 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 02:00:40.555710 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 02:00:40.555710 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 02:00:40.555710 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 02:00:40.555710 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 02:00:40.555710 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 02:00:40.555710 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 could not be found. Sep 16 02:00:40.555710 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:00:40.555710 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:00:40.555710 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:00:40.555710 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:00:40.555710 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:00:40.555710 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:00:40.555710 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 02:00:40.555710 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 02:00:40.555710 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 02:00:40.557131 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 02:00:40.557131 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 02:00:40.557131 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 02:00:40.557131 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 02:00:40.557131 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 02:00:40.557131 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 02:00:40.557131 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 02:00:40.557131 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 could not be found. Sep 16 02:00:40.557131 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:00:40.557131 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:00:40.557131 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:00:40.557131 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:00:40.557131 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:00:40.557131 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:00:40.557131 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 02:00:40.557131 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 02:00:40.557131 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 could not be found. Sep 16 02:00:40.557131 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:00:40.558355 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-69685276-8405-4b09-88fc-4040dabe7e4b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Returning 404 to user: Instance 7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 could not be found. {{(pid=120440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 02:00:40.558355 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-69685276-8405-4b09-88fc-4040dabe7e4b tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7" status: 404 len: 111 microversion: 2.1 time: 0.036412 Sep 16 02:00:40.558355 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 333/680] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:00:40 2022] GET /compute/v2.1/servers/7dca9fff-ed79-43eb-a7ee-9ce16a34a0e7 => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 02:00:40.565792 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-61cbd2ed-4f68-4df5-b9ef-2cf7b468a6b9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:00:40.566406 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-61cbd2ed-4f68-4df5-b9ef-2cf7b468a6b9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 48c9b577-5e65-464f-9328-da6dc694277c] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:00:40.575115 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-61cbd2ed-4f68-4df5-b9ef-2cf7b468a6b9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:40.576518 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-61cbd2ed-4f68-4df5-b9ef-2cf7b468a6b9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:40.577154 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-61cbd2ed-4f68-4df5-b9ef-2cf7b468a6b9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:40.577970 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-61cbd2ed-4f68-4df5-b9ef-2cf7b468a6b9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:40.578515 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-61cbd2ed-4f68-4df5-b9ef-2cf7b468a6b9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:40.578938 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-61cbd2ed-4f68-4df5-b9ef-2cf7b468a6b9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:40.609696 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-61cbd2ed-4f68-4df5-b9ef-2cf7b468a6b9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 48c9b577-5e65-464f-9328-da6dc694277c] Going to try to terminate instance {{(pid=120441) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 02:00:40.700287 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-61cbd2ed-4f68-4df5-b9ef-2cf7b468a6b9 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "DELETE /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c" status: 204 len: 0 microversion: 2.1 time: 0.139549 Sep 16 02:00:40.701952 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 348/681] 10.222.0.42 () {58 vars in 1239 bytes} [Fri Sep 16 02:00:40 2022] DELETE /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c => generated 0 bytes in 142 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 16 02:00:40.711701 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-e872ff68-ed94-49ff-b30e-38eab380160c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:00:40.712707 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-e872ff68-ed94-49ff-b30e-38eab380160c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 48c9b577-5e65-464f-9328-da6dc694277c] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:00:40.719281 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e872ff68-ed94-49ff-b30e-38eab380160c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:40.719754 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e872ff68-ed94-49ff-b30e-38eab380160c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:40.720228 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e872ff68-ed94-49ff-b30e-38eab380160c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:40.720917 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e872ff68-ed94-49ff-b30e-38eab380160c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:40.721371 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e872ff68-ed94-49ff-b30e-38eab380160c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:40.721793 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e872ff68-ed94-49ff-b30e-38eab380160c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:40.860676 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-e872ff68-ed94-49ff-b30e-38eab380160c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:00:40.868245 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-e872ff68-ed94-49ff-b30e-38eab380160c tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c" status: 200 len: 1522 microversion: 2.1 time: 0.162008 Sep 16 02:00:40.868823 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 334/682] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:00:40 2022] GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c => generated 1522 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 02:00:40.897325 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-e0934c22-5ce9-4fab-ab76-853cb429b835 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:00:40.898056 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-e0934c22-5ce9-4fab-ab76-853cb429b835 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: 069b7416-97ef-43ac-97f9-495b8eb0265f] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:00:40.904113 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e0934c22-5ce9-4fab-ab76-853cb429b835 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:40.904605 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e0934c22-5ce9-4fab-ab76-853cb429b835 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:40.905041 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e0934c22-5ce9-4fab-ab76-853cb429b835 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:40.905725 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e0934c22-5ce9-4fab-ab76-853cb429b835 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:40.906179 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e0934c22-5ce9-4fab-ab76-853cb429b835 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:40.906606 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e0934c22-5ce9-4fab-ab76-853cb429b835 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:41.049027 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-e0934c22-5ce9-4fab-ab76-853cb429b835 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:00:41.057183 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-e0934c22-5ce9-4fab-ab76-853cb429b835 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f" status: 200 len: 1364 microversion: 2.1 time: 0.164009 Sep 16 02:00:41.057850 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 349/683] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:00:40 2022] GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:00:41.107875 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [req-079fdc0c-1883-4d0e-bcb1-c42037616d55 req-b8e980ef-4746-49fd-b034-c811fbd630d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "069b7416-97ef-43ac-97f9-495b8eb0265f", "name": "network-vif-plugged", "status": "completed", "tag": "910a23a7-03f3-4a82-b8d8-4b238685b022"}]} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:00:41.118299 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-079fdc0c-1883-4d0e-bcb1-c42037616d55 req-b8e980ef-4746-49fd-b034-c811fbd630d6 service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:41.118783 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-079fdc0c-1883-4d0e-bcb1-c42037616d55 req-b8e980ef-4746-49fd-b034-c811fbd630d6 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:41.119209 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-079fdc0c-1883-4d0e-bcb1-c42037616d55 req-b8e980ef-4746-49fd-b034-c811fbd630d6 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:41.131275 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.compute.server_external_events [req-079fdc0c-1883-4d0e-bcb1-c42037616d55 req-b8e980ef-4746-49fd-b034-c811fbd630d6 service nova] Creating event network-vif-plugged:910a23a7-03f3-4a82-b8d8-4b238685b022 for instance 069b7416-97ef-43ac-97f9-495b8eb0265f on hv-cinder-84914 Sep 16 02:00:41.136817 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [req-079fdc0c-1883-4d0e-bcb1-c42037616d55 req-b8e980ef-4746-49fd-b034-c811fbd630d6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033758 Sep 16 02:00:41.137831 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 335/684] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:00:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:00:41.892200 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-895a732d-0848-40d6-ae5a-ba5223d7fd13 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:00:41.892803 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-895a732d-0848-40d6-ae5a-ba5223d7fd13 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 48c9b577-5e65-464f-9328-da6dc694277c] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:00:41.899089 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-895a732d-0848-40d6-ae5a-ba5223d7fd13 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:41.899561 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-895a732d-0848-40d6-ae5a-ba5223d7fd13 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:41.900120 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-895a732d-0848-40d6-ae5a-ba5223d7fd13 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:41.900801 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-895a732d-0848-40d6-ae5a-ba5223d7fd13 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:41.901244 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-895a732d-0848-40d6-ae5a-ba5223d7fd13 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:41.901657 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-895a732d-0848-40d6-ae5a-ba5223d7fd13 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:42.027746 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-895a732d-0848-40d6-ae5a-ba5223d7fd13 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:00:42.035623 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-895a732d-0848-40d6-ae5a-ba5223d7fd13 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c" status: 200 len: 1522 microversion: 2.1 time: 0.147313 Sep 16 02:00:42.036161 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 350/685] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:00:41 2022] GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c => generated 1522 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:00:42.081594 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-675626fa-e9b9-4c57-b6be-d1dcb6c6f3c5 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:00:42.082317 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-675626fa-e9b9-4c57-b6be-d1dcb6c6f3c5 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: 069b7416-97ef-43ac-97f9-495b8eb0265f] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:00:42.088366 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-675626fa-e9b9-4c57-b6be-d1dcb6c6f3c5 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:42.088851 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-675626fa-e9b9-4c57-b6be-d1dcb6c6f3c5 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:42.089291 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-675626fa-e9b9-4c57-b6be-d1dcb6c6f3c5 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:42.089978 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-675626fa-e9b9-4c57-b6be-d1dcb6c6f3c5 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:42.090434 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-675626fa-e9b9-4c57-b6be-d1dcb6c6f3c5 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:42.090871 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-675626fa-e9b9-4c57-b6be-d1dcb6c6f3c5 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:42.217846 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-675626fa-e9b9-4c57-b6be-d1dcb6c6f3c5 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:00:42.225376 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-675626fa-e9b9-4c57-b6be-d1dcb6c6f3c5 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f" status: 200 len: 1364 microversion: 2.1 time: 0.148478 Sep 16 02:00:42.225937 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 336/686] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:00:42 2022] GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:00:43.058551 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-40df42a4-a67c-4c9f-90ef-a6f2a7ef4367 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:00:43.059162 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-40df42a4-a67c-4c9f-90ef-a6f2a7ef4367 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 48c9b577-5e65-464f-9328-da6dc694277c] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:00:43.065642 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-40df42a4-a67c-4c9f-90ef-a6f2a7ef4367 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:43.066062 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-40df42a4-a67c-4c9f-90ef-a6f2a7ef4367 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:43.066494 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-40df42a4-a67c-4c9f-90ef-a6f2a7ef4367 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:43.067172 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-40df42a4-a67c-4c9f-90ef-a6f2a7ef4367 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:43.067622 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-40df42a4-a67c-4c9f-90ef-a6f2a7ef4367 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:43.068071 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-40df42a4-a67c-4c9f-90ef-a6f2a7ef4367 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:43.249440 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-257c497e-5336-4a40-a11e-ca709c4d639d tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:00:43.250178 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-257c497e-5336-4a40-a11e-ca709c4d639d tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: 069b7416-97ef-43ac-97f9-495b8eb0265f] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:00:43.257255 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-257c497e-5336-4a40-a11e-ca709c4d639d tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:43.257752 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-257c497e-5336-4a40-a11e-ca709c4d639d tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:43.258185 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-257c497e-5336-4a40-a11e-ca709c4d639d tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:43.258887 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-257c497e-5336-4a40-a11e-ca709c4d639d tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:43.259339 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-257c497e-5336-4a40-a11e-ca709c4d639d tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:43.259767 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-257c497e-5336-4a40-a11e-ca709c4d639d tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:43.397430 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-257c497e-5336-4a40-a11e-ca709c4d639d tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:00:43.405083 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-257c497e-5336-4a40-a11e-ca709c4d639d tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f" status: 200 len: 1364 microversion: 2.1 time: 0.160263 Sep 16 02:00:43.405665 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 337/687] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:00:43 2022] GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 02:00:43.462594 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-40df42a4-a67c-4c9f-90ef-a6f2a7ef4367 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:00:43.470111 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-40df42a4-a67c-4c9f-90ef-a6f2a7ef4367 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c" status: 200 len: 1522 microversion: 2.1 time: 0.415388 Sep 16 02:00:43.470667 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 351/688] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:00:43 2022] GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c => generated 1522 bytes in 416 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:00:44.428274 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-3f1cb9a4-3e3e-43ec-888b-5098ef24d350 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:00:44.428893 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-3f1cb9a4-3e3e-43ec-888b-5098ef24d350 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: 069b7416-97ef-43ac-97f9-495b8eb0265f] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:00:44.435778 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3f1cb9a4-3e3e-43ec-888b-5098ef24d350 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:44.436296 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3f1cb9a4-3e3e-43ec-888b-5098ef24d350 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:44.436733 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3f1cb9a4-3e3e-43ec-888b-5098ef24d350 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:44.437425 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3f1cb9a4-3e3e-43ec-888b-5098ef24d350 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:44.437876 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3f1cb9a4-3e3e-43ec-888b-5098ef24d350 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:44.438297 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3f1cb9a4-3e3e-43ec-888b-5098ef24d350 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:44.493192 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-f50c808c-81b1-4ae0-bc3e-0e14dad5af6f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:00:44.494390 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-f50c808c-81b1-4ae0-bc3e-0e14dad5af6f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 48c9b577-5e65-464f-9328-da6dc694277c] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:00:44.501366 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f50c808c-81b1-4ae0-bc3e-0e14dad5af6f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:44.501850 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f50c808c-81b1-4ae0-bc3e-0e14dad5af6f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:44.502537 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f50c808c-81b1-4ae0-bc3e-0e14dad5af6f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:44.503218 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f50c808c-81b1-4ae0-bc3e-0e14dad5af6f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:44.503857 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f50c808c-81b1-4ae0-bc3e-0e14dad5af6f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:44.504301 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f50c808c-81b1-4ae0-bc3e-0e14dad5af6f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:44.590716 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-3f1cb9a4-3e3e-43ec-888b-5098ef24d350 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:00:44.607113 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-3f1cb9a4-3e3e-43ec-888b-5098ef24d350 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f" status: 200 len: 1364 microversion: 2.1 time: 0.182447 Sep 16 02:00:44.628139 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 338/689] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:00:44 2022] GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f => generated 1364 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:00:44.630746 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-f50c808c-81b1-4ae0-bc3e-0e14dad5af6f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '7eb6ab0644bf4fa59d7bba232d6ccb3c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '57aaf234892543698d91303961f14abd', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:00:44.639764 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-f50c808c-81b1-4ae0-bc3e-0e14dad5af6f tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c" status: 200 len: 1480 microversion: 2.1 time: 0.150391 Sep 16 02:00:44.640586 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 352/690] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:00:44 2022] GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c => generated 1480 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 02:00:44.689092 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [req-e1a30056-3629-4845-93ce-45437632e381 req-a53f355e-edcb-4e98-af8a-ca621c369269 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48c9b577-5e65-464f-9328-da6dc694277c", "name": "network-vif-deleted", "tag": "6bf23a1f-07f6-4b96-abf5-7191389578be"}]} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:00:44.698240 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-e1a30056-3629-4845-93ce-45437632e381 req-a53f355e-edcb-4e98-af8a-ca621c369269 service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:44.698714 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-e1a30056-3629-4845-93ce-45437632e381 req-a53f355e-edcb-4e98-af8a-ca621c369269 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:44.699143 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-e1a30056-3629-4845-93ce-45437632e381 req-a53f355e-edcb-4e98-af8a-ca621c369269 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:44.709800 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.compute.server_external_events [req-e1a30056-3629-4845-93ce-45437632e381 req-a53f355e-edcb-4e98-af8a-ca621c369269 service nova] Creating event network-vif-deleted:6bf23a1f-07f6-4b96-abf5-7191389578be for instance 48c9b577-5e65-464f-9328-da6dc694277c on hv-cinder-84914 Sep 16 02:00:44.714639 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [req-e1a30056-3629-4845-93ce-45437632e381 req-a53f355e-edcb-4e98-af8a-ca621c369269 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029227 Sep 16 02:00:44.715252 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 339/691] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:00:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:00:45.634749 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-1e768665-a28b-4fe0-9aa0-bcd259f9939d tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:00:45.635368 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-1e768665-a28b-4fe0-9aa0-bcd259f9939d tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: 069b7416-97ef-43ac-97f9-495b8eb0265f] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:00:45.642794 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1e768665-a28b-4fe0-9aa0-bcd259f9939d tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:45.643282 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1e768665-a28b-4fe0-9aa0-bcd259f9939d tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:45.643743 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1e768665-a28b-4fe0-9aa0-bcd259f9939d tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:45.644468 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1e768665-a28b-4fe0-9aa0-bcd259f9939d tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:45.644918 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1e768665-a28b-4fe0-9aa0-bcd259f9939d tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:45.645341 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1e768665-a28b-4fe0-9aa0-bcd259f9939d tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:45.663966 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-9ff3b36c-2415-4a58-bc36-74f887a02555 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:00:45.664823 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-9ff3b36c-2415-4a58-bc36-74f887a02555 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] [instance: 48c9b577-5e65-464f-9328-da6dc694277c] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:00:45.673135 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9ff3b36c-2415-4a58-bc36-74f887a02555 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:45.673928 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9ff3b36c-2415-4a58-bc36-74f887a02555 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:45.674582 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9ff3b36c-2415-4a58-bc36-74f887a02555 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:45.675464 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9ff3b36c-2415-4a58-bc36-74f887a02555 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:45.676150 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9ff3b36c-2415-4a58-bc36-74f887a02555 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:45.676576 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9ff3b36c-2415-4a58-bc36-74f887a02555 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:45.692412 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.wsgi [None req-9ff3b36c-2415-4a58-bc36-74f887a02555 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] HTTP exception thrown: Instance 48c9b577-5e65-464f-9328-da6dc694277c could not be found. Sep 16 02:00:45.694058 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-9ff3b36c-2415-4a58-bc36-74f887a02555 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Request method failure captured: Sep 16 02:00:45.694058 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: request: GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c HTTP/1.1 Sep 16 02:00:45.694058 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept: application/json Sep 16 02:00:45.694058 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept-Encoding: identity Sep 16 02:00:45.694058 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Connection: close Sep 16 02:00:45.694058 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Length: 0 Sep 16 02:00:45.694058 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Type: application/json Sep 16 02:00:45.694058 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Host: 10.222.0.42 Sep 16 02:00:45.694058 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Openstack-System-Scope: None Sep 16 02:00:45.694058 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: User-Agent: python-urllib3/1.26.12 Sep 16 02:00:45.694058 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Auth-Token: gAAAAABjI9c-Il8-3hF9Li-IW6ki3rCRxsddmEYj-CEjGwEumw94mpgkrl63sWplgEqXoUz3fiC-3x44O1RRD4kaA9W4JY76zYcpF4adB0c8IXHbjAFOjhvg_wlD1HQTgu9jYX9bvxA4OlQVlK-DbI0GW9oqAmi3IZAroqSCl3VtQWlC8iqMZFo Sep 16 02:00:45.694058 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Id: None Sep 16 02:00:45.694058 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Name: None Sep 16 02:00:45.694058 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Identity-Status: Confirmed Sep 16 02:00:45.694058 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Is-Admin-Project: True Sep 16 02:00:45.694058 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Id: default Sep 16 02:00:45.694058 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Name: Default Sep 16 02:00:45.694058 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Id: 57aaf234892543698d91303961f14abd Sep 16 02:00:45.694058 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1497504670 Sep 16 02:00:45.694058 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Role: member,reader Sep 16 02:00:45.694058 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Roles: member,reader Sep 16 02:00:45.695415 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/57aaf234892543698d91303961f14abd"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/57aaf234892543698d91303961f14abd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_57aaf234892543698d91303961f14abd"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/57aaf234892543698d91303961f14abd"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 02:00:45.695415 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1497504670 Sep 16 02:00:45.695415 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Id: 57aaf234892543698d91303961f14abd Sep 16 02:00:45.695415 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1497504670 Sep 16 02:00:45.695415 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User: tempest-ServerRescueNegativeTestJSON-1497504670-project Sep 16 02:00:45.695415 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Id: default Sep 16 02:00:45.695415 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Name: Default Sep 16 02:00:45.695415 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Id: 7eb6ab0644bf4fa59d7bba232d6ccb3c Sep 16 02:00:45.695415 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1497504670-project Sep 16 02:00:45.695415 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: method: > Sep 16 02:00:45.695415 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: exception: Instance 48c9b577-5e65-464f-9328-da6dc694277c could not be found. Sep 16 02:00:45.695415 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: action_args: {'id': '48c9b577-5e65-464f-9328-da6dc694277c'} Sep 16 02:00:45.696196 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 02:00:45.696196 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:00:45.696196 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 02:00:45.696196 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 02:00:45.696196 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 02:00:45.696196 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 02:00:45.696196 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 02:00:45.696196 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 02:00:45.696196 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 02:00:45.696196 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 02:00:45.696196 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48c9b577-5e65-464f-9328-da6dc694277c could not be found. Sep 16 02:00:45.696196 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:00:45.696196 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:00:45.696196 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:00:45.696196 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:00:45.696196 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:00:45.696196 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:00:45.696196 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 02:00:45.696196 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 02:00:45.696196 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 02:00:45.697419 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 02:00:45.697419 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 02:00:45.697419 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 02:00:45.697419 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 02:00:45.697419 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 02:00:45.697419 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 02:00:45.697419 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 02:00:45.697419 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48c9b577-5e65-464f-9328-da6dc694277c could not be found. Sep 16 02:00:45.697419 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:00:45.697419 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:00:45.697419 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:00:45.697419 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:00:45.697419 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:00:45.697419 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:00:45.697419 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 02:00:45.697419 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 02:00:45.697419 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48c9b577-5e65-464f-9328-da6dc694277c could not be found. Sep 16 02:00:45.697419 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:00:45.698502 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-9ff3b36c-2415-4a58-bc36-74f887a02555 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] Returning 404 to user: Instance 48c9b577-5e65-464f-9328-da6dc694277c could not be found. {{(pid=120440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 02:00:45.698502 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-9ff3b36c-2415-4a58-bc36-74f887a02555 tempest-ServerRescueNegativeTestJSON-1497504670 tempest-ServerRescueNegativeTestJSON-1497504670-project] 10.222.0.42 "GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c" status: 404 len: 111 microversion: 2.1 time: 0.036410 Sep 16 02:00:45.698502 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 340/692] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:00:45 2022] GET /compute/v2.1/servers/48c9b577-5e65-464f-9328-da6dc694277c => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 02:00:45.783521 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-1e768665-a28b-4fe0-9aa0-bcd259f9939d tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:00:45.793325 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-1e768665-a28b-4fe0-9aa0-bcd259f9939d tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f" status: 200 len: 1549 microversion: 2.1 time: 0.162663 Sep 16 02:00:45.802936 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 353/693] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:00:45 2022] GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f => generated 1549 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:00:45.817029 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-3ccadd82-b9b6-42b1-9d13-65e290cf484e tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:00:45.817529 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-3ccadd82-b9b6-42b1-9d13-65e290cf484e tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: 069b7416-97ef-43ac-97f9-495b8eb0265f] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:00:45.823261 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3ccadd82-b9b6-42b1-9d13-65e290cf484e tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:45.823750 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3ccadd82-b9b6-42b1-9d13-65e290cf484e tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:45.824234 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3ccadd82-b9b6-42b1-9d13-65e290cf484e tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:45.824936 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3ccadd82-b9b6-42b1-9d13-65e290cf484e tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:45.825922 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3ccadd82-b9b6-42b1-9d13-65e290cf484e tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:45.826356 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3ccadd82-b9b6-42b1-9d13-65e290cf484e tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:45.936043 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-3ccadd82-b9b6-42b1-9d13-65e290cf484e tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.122843 Sep 16 02:00:45.936639 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 341/694] 10.222.0.42 () {58 vars in 1275 bytes} [Fri Sep 16 02:00:45 2022] GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f/os-interface => generated 284 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:00:46.899638 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [req-e63811ad-4490-44d1-9de9-3b40b03abfc7 req-76ab7bf4-d57c-4551-9dcc-72141bbf7a14 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "069b7416-97ef-43ac-97f9-495b8eb0265f", "tag": "910a23a7-03f3-4a82-b8d8-4b238685b022"}]} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:00:46.911020 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-e63811ad-4490-44d1-9de9-3b40b03abfc7 req-76ab7bf4-d57c-4551-9dcc-72141bbf7a14 service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:00:46.911589 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-e63811ad-4490-44d1-9de9-3b40b03abfc7 req-76ab7bf4-d57c-4551-9dcc-72141bbf7a14 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:00:46.912114 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-e63811ad-4490-44d1-9de9-3b40b03abfc7 req-76ab7bf4-d57c-4551-9dcc-72141bbf7a14 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:00:46.929367 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.compute.server_external_events [req-e63811ad-4490-44d1-9de9-3b40b03abfc7 req-76ab7bf4-d57c-4551-9dcc-72141bbf7a14 service nova] Creating event network-changed:910a23a7-03f3-4a82-b8d8-4b238685b022 for instance 069b7416-97ef-43ac-97f9-495b8eb0265f on hv-cinder-84914 Sep 16 02:00:46.936169 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [req-e63811ad-4490-44d1-9de9-3b40b03abfc7 req-76ab7bf4-d57c-4551-9dcc-72141bbf7a14 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039140 Sep 16 02:00:46.937434 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 354/695] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:00:46 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:01:18.577788 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_api:SELECT=87,nova_api:UPDATE=2,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:01:18.578528 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell1:SELECT=54 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:01:18.583379 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-e988bb22-8aa7-4a7b-8ce2-ec31b540316b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:01:18.583859 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-e988bb22-8aa7-4a7b-8ce2-ec31b540316b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:01:18.591178 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e988bb22-8aa7-4a7b-8ce2-ec31b540316b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:18.591656 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e988bb22-8aa7-4a7b-8ce2-ec31b540316b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:18.592133 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e988bb22-8aa7-4a7b-8ce2-ec31b540316b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:18.592812 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e988bb22-8aa7-4a7b-8ce2-ec31b540316b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:18.593310 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e988bb22-8aa7-4a7b-8ce2-ec31b540316b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:18.593679 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e988bb22-8aa7-4a7b-8ce2-ec31b540316b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:18.619211 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-e988bb22-8aa7-4a7b-8ce2-ec31b540316b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366/ips" status: 200 len: 153 microversion: 2.20 time: 0.043309 Sep 16 02:01:18.619769 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 342/696] 10.222.0.42 () {60 vars in 1289 bytes} [Fri Sep 16 02:01:18 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366/ips => generated 153 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 02:01:20.395331 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-4ba08e19-900b-4510-8c36-0ba7ff68b654 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:01:20.395955 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-4ba08e19-900b-4510-8c36-0ba7ff68b654 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:01:20.398679 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_api:SELECT=84,nova_api:INSERT=1,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:01:20.399477 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell1:SELECT=46,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:01:20.405188 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4ba08e19-900b-4510-8c36-0ba7ff68b654 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:20.405671 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4ba08e19-900b-4510-8c36-0ba7ff68b654 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:20.406104 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4ba08e19-900b-4510-8c36-0ba7ff68b654 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:20.406850 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4ba08e19-900b-4510-8c36-0ba7ff68b654 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:20.407354 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4ba08e19-900b-4510-8c36-0ba7ff68b654 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:20.407733 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4ba08e19-900b-4510-8c36-0ba7ff68b654 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:20.434592 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.objects.instance [None req-4ba08e19-900b-4510-8c36-0ba7ff68b654 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lazy-loading 'flavor' on Instance uuid 3582769d-4f26-4b4d-b2d9-e9638db93366 {{(pid=120441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 02:01:20.623293 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-4ba08e19-900b-4510-8c36-0ba7ff68b654 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "POST /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366/action" status: 202 len: 0 microversion: 2.20 time: 0.232651 Sep 16 02:01:20.624213 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 355/697] 10.222.0.42 () {62 vars in 1319 bytes} [Fri Sep 16 02:01:20 2022] POST /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366/action => generated 0 bytes in 235 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 16 02:01:20.633218 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-ed4dba30-1394-4dd6-89d4-71613db006b2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:01:20.634251 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-ed4dba30-1394-4dd6-89d4-71613db006b2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:01:20.640651 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ed4dba30-1394-4dd6-89d4-71613db006b2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:20.641778 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ed4dba30-1394-4dd6-89d4-71613db006b2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:20.642520 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ed4dba30-1394-4dd6-89d4-71613db006b2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:20.643332 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ed4dba30-1394-4dd6-89d4-71613db006b2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:20.643873 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ed4dba30-1394-4dd6-89d4-71613db006b2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:20.644332 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ed4dba30-1394-4dd6-89d4-71613db006b2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:20.773677 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-ed4dba30-1394-4dd6-89d4-71613db006b2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:20.781800 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-ed4dba30-1394-4dd6-89d4-71613db006b2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:20.783317 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-ed4dba30-1394-4dd6-89d4-71613db006b2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:20.784515 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-ed4dba30-1394-4dd6-89d4-71613db006b2 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1724 microversion: 2.20 time: 0.155233 Sep 16 02:01:20.785072 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 343/698] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:01:20 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:01:21.811825 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-765b0c94-5077-4997-acb0-6d7ed122abab tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:01:21.812570 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-765b0c94-5077-4997-acb0-6d7ed122abab tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:01:21.819656 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-765b0c94-5077-4997-acb0-6d7ed122abab tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:21.820158 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-765b0c94-5077-4997-acb0-6d7ed122abab tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:21.820586 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-765b0c94-5077-4997-acb0-6d7ed122abab tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:21.821256 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-765b0c94-5077-4997-acb0-6d7ed122abab tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:21.821699 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-765b0c94-5077-4997-acb0-6d7ed122abab tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:21.822141 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-765b0c94-5077-4997-acb0-6d7ed122abab tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:21.952561 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-765b0c94-5077-4997-acb0-6d7ed122abab tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:21.961198 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-765b0c94-5077-4997-acb0-6d7ed122abab tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:21.963304 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-765b0c94-5077-4997-acb0-6d7ed122abab tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:21.964862 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-765b0c94-5077-4997-acb0-6d7ed122abab tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1724 microversion: 2.20 time: 0.157869 Sep 16 02:01:21.965531 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 356/699] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:01:21 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:01:22.991355 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-e6155dbe-5369-4f80-a846-fd4190a86690 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:01:22.991997 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-e6155dbe-5369-4f80-a846-fd4190a86690 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:01:22.998300 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e6155dbe-5369-4f80-a846-fd4190a86690 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:22.998778 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e6155dbe-5369-4f80-a846-fd4190a86690 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:22.999210 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e6155dbe-5369-4f80-a846-fd4190a86690 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:22.999905 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e6155dbe-5369-4f80-a846-fd4190a86690 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:23.000377 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e6155dbe-5369-4f80-a846-fd4190a86690 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:23.000800 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e6155dbe-5369-4f80-a846-fd4190a86690 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:23.128677 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-e6155dbe-5369-4f80-a846-fd4190a86690 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:23.136642 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-e6155dbe-5369-4f80-a846-fd4190a86690 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:23.138075 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-e6155dbe-5369-4f80-a846-fd4190a86690 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:23.139219 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-e6155dbe-5369-4f80-a846-fd4190a86690 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1724 microversion: 2.20 time: 0.151811 Sep 16 02:01:23.139904 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 344/700] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:01:22 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:01:24.164975 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-0c94542c-a81e-4b73-ba4a-eaec66e63ae3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:01:24.165612 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-0c94542c-a81e-4b73-ba4a-eaec66e63ae3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:01:24.171798 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0c94542c-a81e-4b73-ba4a-eaec66e63ae3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:24.172309 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0c94542c-a81e-4b73-ba4a-eaec66e63ae3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:24.172777 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0c94542c-a81e-4b73-ba4a-eaec66e63ae3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:24.174264 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0c94542c-a81e-4b73-ba4a-eaec66e63ae3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:24.174728 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0c94542c-a81e-4b73-ba4a-eaec66e63ae3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:24.175153 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0c94542c-a81e-4b73-ba4a-eaec66e63ae3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:24.306553 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-0c94542c-a81e-4b73-ba4a-eaec66e63ae3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:24.314772 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-0c94542c-a81e-4b73-ba4a-eaec66e63ae3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:24.316225 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-0c94542c-a81e-4b73-ba4a-eaec66e63ae3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:24.317374 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-0c94542c-a81e-4b73-ba4a-eaec66e63ae3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1724 microversion: 2.20 time: 0.156442 Sep 16 02:01:24.317926 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 357/701] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:01:24 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1724 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:01:25.342822 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-86ea6041-1865-4f03-aa22-c7d70d0c26cf tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:01:25.343360 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-86ea6041-1865-4f03-aa22-c7d70d0c26cf tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:01:25.349745 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-86ea6041-1865-4f03-aa22-c7d70d0c26cf tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:25.350230 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-86ea6041-1865-4f03-aa22-c7d70d0c26cf tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:25.350657 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-86ea6041-1865-4f03-aa22-c7d70d0c26cf tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:25.351344 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-86ea6041-1865-4f03-aa22-c7d70d0c26cf tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:25.351788 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-86ea6041-1865-4f03-aa22-c7d70d0c26cf tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:25.352240 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-86ea6041-1865-4f03-aa22-c7d70d0c26cf tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:25.487064 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-86ea6041-1865-4f03-aa22-c7d70d0c26cf tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:25.495333 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-86ea6041-1865-4f03-aa22-c7d70d0c26cf tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:25.496810 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-86ea6041-1865-4f03-aa22-c7d70d0c26cf tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:25.497966 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-86ea6041-1865-4f03-aa22-c7d70d0c26cf tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1724 microversion: 2.20 time: 0.159095 Sep 16 02:01:25.498539 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 345/702] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:01:25 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 02:01:26.524694 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-9e731e48-3572-46d8-a7cc-fc60a88c50b6 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:01:26.525216 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-9e731e48-3572-46d8-a7cc-fc60a88c50b6 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:01:26.532473 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9e731e48-3572-46d8-a7cc-fc60a88c50b6 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:26.533055 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9e731e48-3572-46d8-a7cc-fc60a88c50b6 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:26.533437 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9e731e48-3572-46d8-a7cc-fc60a88c50b6 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:26.534144 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9e731e48-3572-46d8-a7cc-fc60a88c50b6 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:26.534597 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9e731e48-3572-46d8-a7cc-fc60a88c50b6 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:26.535019 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9e731e48-3572-46d8-a7cc-fc60a88c50b6 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:26.667331 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-9e731e48-3572-46d8-a7cc-fc60a88c50b6 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:26.676081 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-9e731e48-3572-46d8-a7cc-fc60a88c50b6 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:26.677515 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-9e731e48-3572-46d8-a7cc-fc60a88c50b6 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:26.678666 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-9e731e48-3572-46d8-a7cc-fc60a88c50b6 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1724 microversion: 2.20 time: 0.157954 Sep 16 02:01:26.679231 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 358/703] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:01:26 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:01:27.706191 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-fbbe77a3-7098-4493-9d08-235365eddb86 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:01:27.706902 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-fbbe77a3-7098-4493-9d08-235365eddb86 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:01:27.714176 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-fbbe77a3-7098-4493-9d08-235365eddb86 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:27.714668 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-fbbe77a3-7098-4493-9d08-235365eddb86 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:27.715106 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-fbbe77a3-7098-4493-9d08-235365eddb86 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:27.715803 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-fbbe77a3-7098-4493-9d08-235365eddb86 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:27.716431 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-fbbe77a3-7098-4493-9d08-235365eddb86 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:27.716940 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-fbbe77a3-7098-4493-9d08-235365eddb86 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:27.851044 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-fbbe77a3-7098-4493-9d08-235365eddb86 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:27.859150 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-fbbe77a3-7098-4493-9d08-235365eddb86 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:27.861506 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-fbbe77a3-7098-4493-9d08-235365eddb86 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:27.862991 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-fbbe77a3-7098-4493-9d08-235365eddb86 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1724 microversion: 2.20 time: 0.161103 Sep 16 02:01:27.863545 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 346/704] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:01:27 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1724 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:01:28.888038 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-62459f64-e6cf-42ff-9893-20fb4e8eec90 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:01:28.888673 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-62459f64-e6cf-42ff-9893-20fb4e8eec90 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:01:28.895734 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-62459f64-e6cf-42ff-9893-20fb4e8eec90 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:28.896233 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-62459f64-e6cf-42ff-9893-20fb4e8eec90 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:28.896665 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-62459f64-e6cf-42ff-9893-20fb4e8eec90 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:28.897346 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-62459f64-e6cf-42ff-9893-20fb4e8eec90 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:28.897791 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-62459f64-e6cf-42ff-9893-20fb4e8eec90 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:28.898213 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-62459f64-e6cf-42ff-9893-20fb4e8eec90 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:29.028482 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-62459f64-e6cf-42ff-9893-20fb4e8eec90 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:29.036770 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-62459f64-e6cf-42ff-9893-20fb4e8eec90 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:29.038215 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-62459f64-e6cf-42ff-9893-20fb4e8eec90 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:29.039363 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-62459f64-e6cf-42ff-9893-20fb4e8eec90 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1724 microversion: 2.20 time: 0.155219 Sep 16 02:01:29.039914 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 359/705] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:01:28 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1724 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:01:30.065682 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-1e239ea3-fa0c-458a-82e2-c28d98dab78e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:01:30.066219 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-1e239ea3-fa0c-458a-82e2-c28d98dab78e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:01:30.073338 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1e239ea3-fa0c-458a-82e2-c28d98dab78e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:30.073837 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1e239ea3-fa0c-458a-82e2-c28d98dab78e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:30.074311 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1e239ea3-fa0c-458a-82e2-c28d98dab78e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:30.075051 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1e239ea3-fa0c-458a-82e2-c28d98dab78e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:30.075540 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1e239ea3-fa0c-458a-82e2-c28d98dab78e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:30.075990 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1e239ea3-fa0c-458a-82e2-c28d98dab78e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:30.211995 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-1e239ea3-fa0c-458a-82e2-c28d98dab78e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:30.220114 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-1e239ea3-fa0c-458a-82e2-c28d98dab78e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:30.222313 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-1e239ea3-fa0c-458a-82e2-c28d98dab78e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:30.223518 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-1e239ea3-fa0c-458a-82e2-c28d98dab78e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1724 microversion: 2.20 time: 0.161969 Sep 16 02:01:30.224105 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 347/706] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:01:30 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:01:31.248978 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-58a90522-7712-4950-b2a0-de3c5e80238b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:01:31.249576 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-58a90522-7712-4950-b2a0-de3c5e80238b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:01:31.257502 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-58a90522-7712-4950-b2a0-de3c5e80238b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:31.257978 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-58a90522-7712-4950-b2a0-de3c5e80238b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:31.258408 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-58a90522-7712-4950-b2a0-de3c5e80238b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:31.259091 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-58a90522-7712-4950-b2a0-de3c5e80238b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:31.259536 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-58a90522-7712-4950-b2a0-de3c5e80238b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:31.259976 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-58a90522-7712-4950-b2a0-de3c5e80238b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:31.396426 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-58a90522-7712-4950-b2a0-de3c5e80238b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:31.404662 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-58a90522-7712-4950-b2a0-de3c5e80238b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:31.406096 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-58a90522-7712-4950-b2a0-de3c5e80238b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:31.407257 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-58a90522-7712-4950-b2a0-de3c5e80238b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1724 microversion: 2.20 time: 0.162221 Sep 16 02:01:31.407809 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 360/707] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:01:31 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:01:32.433156 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-904c96d1-3448-4715-9fe1-d9a2862ad397 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:01:32.433749 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-904c96d1-3448-4715-9fe1-d9a2862ad397 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:01:32.439595 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-904c96d1-3448-4715-9fe1-d9a2862ad397 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:32.440107 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-904c96d1-3448-4715-9fe1-d9a2862ad397 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:32.440542 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-904c96d1-3448-4715-9fe1-d9a2862ad397 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:32.441254 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-904c96d1-3448-4715-9fe1-d9a2862ad397 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:32.441706 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-904c96d1-3448-4715-9fe1-d9a2862ad397 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:32.442128 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-904c96d1-3448-4715-9fe1-d9a2862ad397 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:32.575930 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-904c96d1-3448-4715-9fe1-d9a2862ad397 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:32.585643 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-904c96d1-3448-4715-9fe1-d9a2862ad397 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:32.587090 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-904c96d1-3448-4715-9fe1-d9a2862ad397 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:32.588293 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-904c96d1-3448-4715-9fe1-d9a2862ad397 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1745 microversion: 2.20 time: 0.159175 Sep 16 02:01:32.588849 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 348/708] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:01:32 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 02:01:33.615209 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-0235cf4e-5992-4fc9-914c-e6cfac859cb9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:01:33.615829 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-0235cf4e-5992-4fc9-914c-e6cfac859cb9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:01:33.622268 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0235cf4e-5992-4fc9-914c-e6cfac859cb9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:33.622782 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0235cf4e-5992-4fc9-914c-e6cfac859cb9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:33.623276 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0235cf4e-5992-4fc9-914c-e6cfac859cb9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:33.623995 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0235cf4e-5992-4fc9-914c-e6cfac859cb9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:33.624459 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0235cf4e-5992-4fc9-914c-e6cfac859cb9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:33.624888 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0235cf4e-5992-4fc9-914c-e6cfac859cb9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:33.762070 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-0235cf4e-5992-4fc9-914c-e6cfac859cb9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:33.770262 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-0235cf4e-5992-4fc9-914c-e6cfac859cb9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:33.771697 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-0235cf4e-5992-4fc9-914c-e6cfac859cb9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:33.772880 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-0235cf4e-5992-4fc9-914c-e6cfac859cb9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1745 microversion: 2.20 time: 0.162253 Sep 16 02:01:33.773439 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 361/709] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:01:33 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1745 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:01:34.800901 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-34eb1fdf-0217-497c-a430-1618ecce074d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:01:34.801641 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-34eb1fdf-0217-497c-a430-1618ecce074d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:01:34.812418 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-34eb1fdf-0217-497c-a430-1618ecce074d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:34.812418 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-34eb1fdf-0217-497c-a430-1618ecce074d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:34.812827 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-34eb1fdf-0217-497c-a430-1618ecce074d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:34.813570 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-34eb1fdf-0217-497c-a430-1618ecce074d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:34.814011 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-34eb1fdf-0217-497c-a430-1618ecce074d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:34.815028 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-34eb1fdf-0217-497c-a430-1618ecce074d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:34.945997 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-34eb1fdf-0217-497c-a430-1618ecce074d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:34.954438 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-34eb1fdf-0217-497c-a430-1618ecce074d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:34.956013 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-34eb1fdf-0217-497c-a430-1618ecce074d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:34.957183 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-34eb1fdf-0217-497c-a430-1618ecce074d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1745 microversion: 2.20 time: 0.160900 Sep 16 02:01:34.957746 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 349/710] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:01:34 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1745 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:01:35.336416 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [req-6018273a-425f-4251-adec-e3e31229c5ae req-73e352f9-ab21-4de0-9f6a-f1d6cffb83bc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3582769d-4f26-4b4d-b2d9-e9638db93366", "name": "network-vif-plugged", "status": "completed", "tag": "4127457c-ae36-44e0-abd0-2ee3fefef488"}]} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:01:35.347960 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-6018273a-425f-4251-adec-e3e31229c5ae req-73e352f9-ab21-4de0-9f6a-f1d6cffb83bc service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:35.348319 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-6018273a-425f-4251-adec-e3e31229c5ae req-73e352f9-ab21-4de0-9f6a-f1d6cffb83bc service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:35.348698 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-6018273a-425f-4251-adec-e3e31229c5ae req-73e352f9-ab21-4de0-9f6a-f1d6cffb83bc service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:35.359748 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.compute.server_external_events [req-6018273a-425f-4251-adec-e3e31229c5ae req-73e352f9-ab21-4de0-9f6a-f1d6cffb83bc service nova] Creating event network-vif-plugged:4127457c-ae36-44e0-abd0-2ee3fefef488 for instance 3582769d-4f26-4b4d-b2d9-e9638db93366 on hv-cinder-84914 Sep 16 02:01:35.364769 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [req-6018273a-425f-4251-adec-e3e31229c5ae req-73e352f9-ab21-4de0-9f6a-f1d6cffb83bc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032064 Sep 16 02:01:35.365540 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 362/711] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:01:35 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:01:35.983294 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-7834aeea-e7c1-4961-9e80-0b5c5da678f1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:01:35.983899 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-7834aeea-e7c1-4961-9e80-0b5c5da678f1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:01:35.990333 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7834aeea-e7c1-4961-9e80-0b5c5da678f1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:35.990821 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7834aeea-e7c1-4961-9e80-0b5c5da678f1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:35.991255 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7834aeea-e7c1-4961-9e80-0b5c5da678f1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:35.991961 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7834aeea-e7c1-4961-9e80-0b5c5da678f1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:35.992420 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7834aeea-e7c1-4961-9e80-0b5c5da678f1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:35.992843 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7834aeea-e7c1-4961-9e80-0b5c5da678f1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:36.125312 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-7834aeea-e7c1-4961-9e80-0b5c5da678f1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:36.135671 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-7834aeea-e7c1-4961-9e80-0b5c5da678f1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:36.137161 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-7834aeea-e7c1-4961-9e80-0b5c5da678f1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:36.138348 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-7834aeea-e7c1-4961-9e80-0b5c5da678f1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1745 microversion: 2.20 time: 0.158938 Sep 16 02:01:36.138911 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 350/712] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:01:35 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1745 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:01:37.165082 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-e288e868-a33a-4e09-9575-bab880223040 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:01:37.165771 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-e288e868-a33a-4e09-9575-bab880223040 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:01:37.171802 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e288e868-a33a-4e09-9575-bab880223040 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:37.172309 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e288e868-a33a-4e09-9575-bab880223040 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:37.172740 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e288e868-a33a-4e09-9575-bab880223040 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:37.173405 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e288e868-a33a-4e09-9575-bab880223040 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:37.173848 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e288e868-a33a-4e09-9575-bab880223040 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:37.174267 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e288e868-a33a-4e09-9575-bab880223040 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:37.304149 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-e288e868-a33a-4e09-9575-bab880223040 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:37.312182 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-e288e868-a33a-4e09-9575-bab880223040 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:37.313611 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-e288e868-a33a-4e09-9575-bab880223040 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:37.314756 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-e288e868-a33a-4e09-9575-bab880223040 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1745 microversion: 2.20 time: 0.154620 Sep 16 02:01:37.315307 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 363/713] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:01:37 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1745 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:01:38.340508 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-38133dac-fe0b-49ef-b95d-2043f5ab02d4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:01:38.341123 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-38133dac-fe0b-49ef-b95d-2043f5ab02d4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:01:38.347711 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-38133dac-fe0b-49ef-b95d-2043f5ab02d4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:38.348227 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-38133dac-fe0b-49ef-b95d-2043f5ab02d4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:38.349457 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-38133dac-fe0b-49ef-b95d-2043f5ab02d4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:38.350210 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-38133dac-fe0b-49ef-b95d-2043f5ab02d4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:38.350677 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-38133dac-fe0b-49ef-b95d-2043f5ab02d4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:38.351105 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-38133dac-fe0b-49ef-b95d-2043f5ab02d4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:38.481143 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-38133dac-fe0b-49ef-b95d-2043f5ab02d4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:38.489128 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-38133dac-fe0b-49ef-b95d-2043f5ab02d4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:38.490623 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-38133dac-fe0b-49ef-b95d-2043f5ab02d4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:38.491781 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-38133dac-fe0b-49ef-b95d-2043f5ab02d4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1745 microversion: 2.20 time: 0.155166 Sep 16 02:01:38.492384 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 351/714] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:01:38 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1745 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:01:39.518651 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-e0ea5822-8c11-4bf0-a70c-ac67fc8a1a6a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:01:39.519976 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-e0ea5822-8c11-4bf0-a70c-ac67fc8a1a6a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:01:39.526862 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e0ea5822-8c11-4bf0-a70c-ac67fc8a1a6a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:39.527605 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e0ea5822-8c11-4bf0-a70c-ac67fc8a1a6a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:39.528094 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e0ea5822-8c11-4bf0-a70c-ac67fc8a1a6a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:39.528981 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e0ea5822-8c11-4bf0-a70c-ac67fc8a1a6a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:39.529611 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e0ea5822-8c11-4bf0-a70c-ac67fc8a1a6a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:39.530271 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e0ea5822-8c11-4bf0-a70c-ac67fc8a1a6a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:39.682406 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-e0ea5822-8c11-4bf0-a70c-ac67fc8a1a6a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:39.690790 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-e0ea5822-8c11-4bf0-a70c-ac67fc8a1a6a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:39.692554 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-e0ea5822-8c11-4bf0-a70c-ac67fc8a1a6a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:39.693752 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-e0ea5822-8c11-4bf0-a70c-ac67fc8a1a6a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1740 microversion: 2.20 time: 0.179571 Sep 16 02:01:39.711401 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 364/715] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:01:39 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1740 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:01:40.720269 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-e11e62c0-f98f-4b2f-83bb-4fb6245b066e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:01:40.720872 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-e11e62c0-f98f-4b2f-83bb-4fb6245b066e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:01:40.728004 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e11e62c0-f98f-4b2f-83bb-4fb6245b066e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:40.728860 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e11e62c0-f98f-4b2f-83bb-4fb6245b066e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:40.729446 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e11e62c0-f98f-4b2f-83bb-4fb6245b066e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:40.730302 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e11e62c0-f98f-4b2f-83bb-4fb6245b066e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:40.730898 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e11e62c0-f98f-4b2f-83bb-4fb6245b066e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:40.731470 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e11e62c0-f98f-4b2f-83bb-4fb6245b066e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:40.871520 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-e11e62c0-f98f-4b2f-83bb-4fb6245b066e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:40.879920 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-e11e62c0-f98f-4b2f-83bb-4fb6245b066e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:40.881411 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-e11e62c0-f98f-4b2f-83bb-4fb6245b066e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:40.882579 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-e11e62c0-f98f-4b2f-83bb-4fb6245b066e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1740 microversion: 2.20 time: 0.166412 Sep 16 02:01:40.883445 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 352/716] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:01:40 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1740 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:01:41.911696 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-c354b68b-c021-4439-90bb-cdbf0040df49 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:01:41.913073 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-c354b68b-c021-4439-90bb-cdbf0040df49 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:01:41.919689 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c354b68b-c021-4439-90bb-cdbf0040df49 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:41.920581 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c354b68b-c021-4439-90bb-cdbf0040df49 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:41.921245 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c354b68b-c021-4439-90bb-cdbf0040df49 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:41.922258 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c354b68b-c021-4439-90bb-cdbf0040df49 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:41.922904 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c354b68b-c021-4439-90bb-cdbf0040df49 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:41.923483 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c354b68b-c021-4439-90bb-cdbf0040df49 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:42.070054 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-c354b68b-c021-4439-90bb-cdbf0040df49 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:42.081330 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-c354b68b-c021-4439-90bb-cdbf0040df49 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:42.082701 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-c354b68b-c021-4439-90bb-cdbf0040df49 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:42.084301 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-c354b68b-c021-4439-90bb-cdbf0040df49 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1740 microversion: 2.20 time: 0.177723 Sep 16 02:01:42.084859 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 365/717] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:01:41 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1740 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:01:43.117092 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-02369360-53bc-469b-b400-391abbf6686b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:01:43.117684 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-02369360-53bc-469b-b400-391abbf6686b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:01:43.124931 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-02369360-53bc-469b-b400-391abbf6686b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:43.125422 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-02369360-53bc-469b-b400-391abbf6686b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:43.126002 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-02369360-53bc-469b-b400-391abbf6686b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:43.126888 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-02369360-53bc-469b-b400-391abbf6686b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:43.127341 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-02369360-53bc-469b-b400-391abbf6686b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:43.127766 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-02369360-53bc-469b-b400-391abbf6686b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:43.277529 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-02369360-53bc-469b-b400-391abbf6686b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:43.285933 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-02369360-53bc-469b-b400-391abbf6686b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:43.287663 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-02369360-53bc-469b-b400-391abbf6686b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:43.289021 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-02369360-53bc-469b-b400-391abbf6686b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1740 microversion: 2.20 time: 0.175894 Sep 16 02:01:43.289571 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 353/718] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:01:43 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1740 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 02:01:44.314984 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-048c64e7-9cf7-4767-ab68-74572372046b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:01:44.315590 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-048c64e7-9cf7-4767-ab68-74572372046b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:01:44.322149 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-048c64e7-9cf7-4767-ab68-74572372046b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:44.322633 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-048c64e7-9cf7-4767-ab68-74572372046b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:44.323128 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-048c64e7-9cf7-4767-ab68-74572372046b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:44.323814 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-048c64e7-9cf7-4767-ab68-74572372046b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:44.324290 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-048c64e7-9cf7-4767-ab68-74572372046b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:44.324973 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-048c64e7-9cf7-4767-ab68-74572372046b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:44.465372 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-048c64e7-9cf7-4767-ab68-74572372046b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:44.475576 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-048c64e7-9cf7-4767-ab68-74572372046b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:44.477669 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-048c64e7-9cf7-4767-ab68-74572372046b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:44.478852 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-048c64e7-9cf7-4767-ab68-74572372046b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1740 microversion: 2.20 time: 0.168054 Sep 16 02:01:44.479592 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 366/719] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:01:44 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1740 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:01:45.505102 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-f33c1889-8000-4914-84d2-9d2e5656aaf9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:01:45.505740 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-f33c1889-8000-4914-84d2-9d2e5656aaf9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:01:45.514200 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f33c1889-8000-4914-84d2-9d2e5656aaf9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:45.514895 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f33c1889-8000-4914-84d2-9d2e5656aaf9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:45.515448 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f33c1889-8000-4914-84d2-9d2e5656aaf9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:45.516637 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f33c1889-8000-4914-84d2-9d2e5656aaf9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:45.517225 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f33c1889-8000-4914-84d2-9d2e5656aaf9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:45.517905 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f33c1889-8000-4914-84d2-9d2e5656aaf9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:45.659738 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-f33c1889-8000-4914-84d2-9d2e5656aaf9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:45.670775 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-f33c1889-8000-4914-84d2-9d2e5656aaf9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:45.672259 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-f33c1889-8000-4914-84d2-9d2e5656aaf9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:45.673439 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-f33c1889-8000-4914-84d2-9d2e5656aaf9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1740 microversion: 2.20 time: 0.172676 Sep 16 02:01:45.674182 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 354/720] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:01:45 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1740 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:01:46.699276 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-1241eaa7-8748-4bad-9863-250915a67d22 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:01:46.699923 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-1241eaa7-8748-4bad-9863-250915a67d22 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:01:46.706837 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1241eaa7-8748-4bad-9863-250915a67d22 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:46.707327 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1241eaa7-8748-4bad-9863-250915a67d22 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:46.708542 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1241eaa7-8748-4bad-9863-250915a67d22 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:46.709435 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1241eaa7-8748-4bad-9863-250915a67d22 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:46.709897 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1241eaa7-8748-4bad-9863-250915a67d22 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:46.710329 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1241eaa7-8748-4bad-9863-250915a67d22 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:46.869870 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-1241eaa7-8748-4bad-9863-250915a67d22 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:46.878114 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-1241eaa7-8748-4bad-9863-250915a67d22 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:46.879637 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-1241eaa7-8748-4bad-9863-250915a67d22 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:46.881554 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-1241eaa7-8748-4bad-9863-250915a67d22 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1740 microversion: 2.20 time: 0.186108 Sep 16 02:01:46.882111 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 367/721] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:01:46 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1740 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:01:47.906997 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-286f64c7-19cd-4e40-a8fb-81beb0d9a617 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:01:47.908384 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-286f64c7-19cd-4e40-a8fb-81beb0d9a617 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:01:47.915823 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-286f64c7-19cd-4e40-a8fb-81beb0d9a617 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:47.916553 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-286f64c7-19cd-4e40-a8fb-81beb0d9a617 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:47.916983 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-286f64c7-19cd-4e40-a8fb-81beb0d9a617 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:47.917863 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-286f64c7-19cd-4e40-a8fb-81beb0d9a617 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:47.918432 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-286f64c7-19cd-4e40-a8fb-81beb0d9a617 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:47.918809 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-286f64c7-19cd-4e40-a8fb-81beb0d9a617 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:48.065677 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-286f64c7-19cd-4e40-a8fb-81beb0d9a617 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:48.075023 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-286f64c7-19cd-4e40-a8fb-81beb0d9a617 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:48.076509 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-286f64c7-19cd-4e40-a8fb-81beb0d9a617 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:48.077904 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-286f64c7-19cd-4e40-a8fb-81beb0d9a617 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1740 microversion: 2.20 time: 0.174994 Sep 16 02:01:48.078478 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 355/722] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:01:47 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1740 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:01:49.105298 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-a7d2c70a-104b-47ab-b1c7-220d75ab8c83 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:01:49.105979 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-a7d2c70a-104b-47ab-b1c7-220d75ab8c83 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:01:49.121493 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a7d2c70a-104b-47ab-b1c7-220d75ab8c83 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:49.121493 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a7d2c70a-104b-47ab-b1c7-220d75ab8c83 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:49.121802 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a7d2c70a-104b-47ab-b1c7-220d75ab8c83 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:49.126982 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a7d2c70a-104b-47ab-b1c7-220d75ab8c83 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:49.127816 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a7d2c70a-104b-47ab-b1c7-220d75ab8c83 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:49.128780 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a7d2c70a-104b-47ab-b1c7-220d75ab8c83 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:49.370597 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-a7d2c70a-104b-47ab-b1c7-220d75ab8c83 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:49.380772 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-a7d2c70a-104b-47ab-b1c7-220d75ab8c83 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:49.382272 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-a7d2c70a-104b-47ab-b1c7-220d75ab8c83 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:49.383464 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-a7d2c70a-104b-47ab-b1c7-220d75ab8c83 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1740 microversion: 2.20 time: 0.282606 Sep 16 02:01:49.390850 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 368/723] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:01:49 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1740 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:01:50.413289 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-f8b0f903-7fec-4c51-bb6d-f001c761bbdb tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:01:50.413951 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-f8b0f903-7fec-4c51-bb6d-f001c761bbdb tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:01:50.419441 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_api:SELECT=29 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:01:50.421948 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f8b0f903-7fec-4c51-bb6d-f001c761bbdb tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:50.422787 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f8b0f903-7fec-4c51-bb6d-f001c761bbdb tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:50.423468 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f8b0f903-7fec-4c51-bb6d-f001c761bbdb tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:50.424429 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f8b0f903-7fec-4c51-bb6d-f001c761bbdb tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:50.425365 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f8b0f903-7fec-4c51-bb6d-f001c761bbdb tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:50.426029 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f8b0f903-7fec-4c51-bb6d-f001c761bbdb tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:50.429964 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell1:SELECT=83 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:01:50.573026 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-f8b0f903-7fec-4c51-bb6d-f001c761bbdb tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:50.581195 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-f8b0f903-7fec-4c51-bb6d-f001c761bbdb tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:50.583378 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-f8b0f903-7fec-4c51-bb6d-f001c761bbdb tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:50.584858 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-f8b0f903-7fec-4c51-bb6d-f001c761bbdb tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1740 microversion: 2.20 time: 0.177221 Sep 16 02:01:50.585402 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 356/724] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:01:50 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1740 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:01:51.610559 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-caaa04f8-36c1-4db3-ab9b-1f6da1d3f17c tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:01:51.611177 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-caaa04f8-36c1-4db3-ab9b-1f6da1d3f17c tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:01:51.614149 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_api:SELECT=29 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:01:51.619547 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-caaa04f8-36c1-4db3-ab9b-1f6da1d3f17c tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:51.620081 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-caaa04f8-36c1-4db3-ab9b-1f6da1d3f17c tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:51.620527 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-caaa04f8-36c1-4db3-ab9b-1f6da1d3f17c tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:51.621227 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-caaa04f8-36c1-4db3-ab9b-1f6da1d3f17c tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:51.621682 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-caaa04f8-36c1-4db3-ab9b-1f6da1d3f17c tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:51.622110 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-caaa04f8-36c1-4db3-ab9b-1f6da1d3f17c tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:51.624968 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell1:SELECT=90,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:01:51.820405 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-caaa04f8-36c1-4db3-ab9b-1f6da1d3f17c tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:51.828633 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-caaa04f8-36c1-4db3-ab9b-1f6da1d3f17c tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:51.830085 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-caaa04f8-36c1-4db3-ab9b-1f6da1d3f17c tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:51.831295 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-caaa04f8-36c1-4db3-ab9b-1f6da1d3f17c tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1722 microversion: 2.20 time: 0.224539 Sep 16 02:01:51.831861 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 369/725] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:01:51 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1722 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:01:52.860610 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-b1e0e971-a3ca-4a47-be49-d770338f31c9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:01:52.861256 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-b1e0e971-a3ca-4a47-be49-d770338f31c9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:01:52.868356 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b1e0e971-a3ca-4a47-be49-d770338f31c9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:52.868832 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b1e0e971-a3ca-4a47-be49-d770338f31c9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:52.869270 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b1e0e971-a3ca-4a47-be49-d770338f31c9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:52.869960 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b1e0e971-a3ca-4a47-be49-d770338f31c9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:52.870426 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b1e0e971-a3ca-4a47-be49-d770338f31c9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:52.870854 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b1e0e971-a3ca-4a47-be49-d770338f31c9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:53.007744 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-b1e0e971-a3ca-4a47-be49-d770338f31c9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:53.015722 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-b1e0e971-a3ca-4a47-be49-d770338f31c9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:53.017307 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-b1e0e971-a3ca-4a47-be49-d770338f31c9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:53.018461 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-b1e0e971-a3ca-4a47-be49-d770338f31c9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1722 microversion: 2.20 time: 0.161803 Sep 16 02:01:53.019020 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 357/726] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:01:52 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1722 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:01:54.045925 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-3d9bd037-591c-42f0-bfef-408d59eed9f8 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:01:54.046639 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-3d9bd037-591c-42f0-bfef-408d59eed9f8 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:01:54.053349 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3d9bd037-591c-42f0-bfef-408d59eed9f8 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:54.053900 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3d9bd037-591c-42f0-bfef-408d59eed9f8 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:54.054397 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3d9bd037-591c-42f0-bfef-408d59eed9f8 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:54.055194 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3d9bd037-591c-42f0-bfef-408d59eed9f8 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:54.055713 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3d9bd037-591c-42f0-bfef-408d59eed9f8 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:54.056241 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3d9bd037-591c-42f0-bfef-408d59eed9f8 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:54.202106 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-3d9bd037-591c-42f0-bfef-408d59eed9f8 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:54.219879 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-3d9bd037-591c-42f0-bfef-408d59eed9f8 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:54.221612 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-3d9bd037-591c-42f0-bfef-408d59eed9f8 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:54.222796 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-3d9bd037-591c-42f0-bfef-408d59eed9f8 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1725 microversion: 2.20 time: 0.180927 Sep 16 02:01:54.230676 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 370/727] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:01:54 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1725 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:01:54.250363 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-f156d943-f5dd-4509-8c47-dd7096fa27c7 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "871ea4d9-f95e-4650-aa3a-2cf053e7d973"}} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:01:54.253066 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-f156d943-f5dd-4509-8c47-dd7096fa27c7 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:01:54.260916 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f156d943-f5dd-4509-8c47-dd7096fa27c7 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:54.261327 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f156d943-f5dd-4509-8c47-dd7096fa27c7 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:54.261838 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f156d943-f5dd-4509-8c47-dd7096fa27c7 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:54.262650 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f156d943-f5dd-4509-8c47-dd7096fa27c7 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:54.263102 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f156d943-f5dd-4509-8c47-dd7096fa27c7 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:54.263525 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f156d943-f5dd-4509-8c47-dd7096fa27c7 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:54.584327 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-f156d943-f5dd-4509-8c47-dd7096fa27c7 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "POST /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.338542 Sep 16 02:01:54.585193 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 358/728] 10.222.0.42 () {62 vars in 1364 bytes} [Fri Sep 16 02:01:54 2022] POST /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366/os-volume_attachments => generated 188 bytes in 340 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 02:01:54.715041 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-c0c51323-e1ae-41a3-a2ba-9c26a4f5977b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:01:54.715529 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-c0c51323-e1ae-41a3-a2ba-9c26a4f5977b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:01:54.721628 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c0c51323-e1ae-41a3-a2ba-9c26a4f5977b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:54.722105 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c0c51323-e1ae-41a3-a2ba-9c26a4f5977b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:54.722536 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c0c51323-e1ae-41a3-a2ba-9c26a4f5977b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:54.723765 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c0c51323-e1ae-41a3-a2ba-9c26a4f5977b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:54.724278 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c0c51323-e1ae-41a3-a2ba-9c26a4f5977b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:54.724707 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c0c51323-e1ae-41a3-a2ba-9c26a4f5977b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:54.979780 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-c0c51323-e1ae-41a3-a2ba-9c26a4f5977b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366/os-volume_attachments/871ea4d9-f95e-4650-aa3a-2cf053e7d973" status: 202 len: 0 microversion: 2.20 time: 0.266117 Sep 16 02:01:54.979780 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 371/729] 10.222.0.42 () {60 vars in 1457 bytes} [Fri Sep 16 02:01:54 2022] DELETE /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366/os-volume_attachments/871ea4d9-f95e-4650-aa3a-2cf053e7d973 => generated 0 bytes in 267 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 16 02:01:55.044148 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-67868df2-9235-406a-975c-081fd6a50179 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:01:55.045051 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-67868df2-9235-406a-975c-081fd6a50179 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:01:55.052837 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-67868df2-9235-406a-975c-081fd6a50179 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:55.053323 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-67868df2-9235-406a-975c-081fd6a50179 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:55.053758 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-67868df2-9235-406a-975c-081fd6a50179 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:55.054442 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-67868df2-9235-406a-975c-081fd6a50179 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:55.054896 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-67868df2-9235-406a-975c-081fd6a50179 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:55.055315 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-67868df2-9235-406a-975c-081fd6a50179 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:55.085685 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-67868df2-9235-406a-975c-081fd6a50179 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120440) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 16 02:01:55.153811 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-67868df2-9235-406a-975c-081fd6a50179 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "POST /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366/action" status: 202 len: 0 microversion: 2.20 time: 0.114164 Sep 16 02:01:55.154421 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 359/730] 10.222.0.42 () {62 vars in 1319 bytes} [Fri Sep 16 02:01:55 2022] POST /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366/action => generated 0 bytes in 115 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 16 02:01:55.162916 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-5198fe6a-81c7-494c-aff4-a5788613e92d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:01:55.163759 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-5198fe6a-81c7-494c-aff4-a5788613e92d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:01:55.176488 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5198fe6a-81c7-494c-aff4-a5788613e92d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:55.177223 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5198fe6a-81c7-494c-aff4-a5788613e92d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:55.177707 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5198fe6a-81c7-494c-aff4-a5788613e92d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:55.178653 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5198fe6a-81c7-494c-aff4-a5788613e92d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:55.179329 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5198fe6a-81c7-494c-aff4-a5788613e92d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:55.179984 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5198fe6a-81c7-494c-aff4-a5788613e92d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:55.326415 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-5198fe6a-81c7-494c-aff4-a5788613e92d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:55.334568 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-5198fe6a-81c7-494c-aff4-a5788613e92d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:55.336187 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-5198fe6a-81c7-494c-aff4-a5788613e92d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:55.337589 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-5198fe6a-81c7-494c-aff4-a5788613e92d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1673 microversion: 2.20 time: 0.178817 Sep 16 02:01:55.338625 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 372/731] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:01:55 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1673 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:01:55.473402 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [req-1baefa79-59aa-4e87-849f-67ad062cf3b0 req-ec3ba9df-f4c6-4ac8-9e8b-d00ac54b277a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3582769d-4f26-4b4d-b2d9-e9638db93366", "name": "network-vif-unplugged", "status": "completed", "tag": "4127457c-ae36-44e0-abd0-2ee3fefef488"}]} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:01:55.488922 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-1baefa79-59aa-4e87-849f-67ad062cf3b0 req-ec3ba9df-f4c6-4ac8-9e8b-d00ac54b277a service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:55.489888 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-1baefa79-59aa-4e87-849f-67ad062cf3b0 req-ec3ba9df-f4c6-4ac8-9e8b-d00ac54b277a service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:55.490494 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-1baefa79-59aa-4e87-849f-67ad062cf3b0 req-ec3ba9df-f4c6-4ac8-9e8b-d00ac54b277a service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:55.502901 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.compute.server_external_events [req-1baefa79-59aa-4e87-849f-67ad062cf3b0 req-ec3ba9df-f4c6-4ac8-9e8b-d00ac54b277a service nova] Unable to find a host for instance 3582769d-4f26-4b4d-b2d9-e9638db93366. Dropping event network-vif-unplugged {{(pid=120440) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 16 02:01:55.504620 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [req-1baefa79-59aa-4e87-849f-67ad062cf3b0 req-ec3ba9df-f4c6-4ac8-9e8b-d00ac54b277a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.035517 Sep 16 02:01:55.505876 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 360/732] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:01:55 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 38 msecs (HTTP/1.1 207) 9 headers in 367 bytes (2 switches on core 0) Sep 16 02:01:56.365902 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-bca64e92-9764-4016-bdc6-2ddc991fde04 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:01:56.368663 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-bca64e92-9764-4016-bdc6-2ddc991fde04 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:01:56.376760 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-bca64e92-9764-4016-bdc6-2ddc991fde04 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:56.377515 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-bca64e92-9764-4016-bdc6-2ddc991fde04 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:56.378245 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-bca64e92-9764-4016-bdc6-2ddc991fde04 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:56.379495 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-bca64e92-9764-4016-bdc6-2ddc991fde04 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:56.380445 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-bca64e92-9764-4016-bdc6-2ddc991fde04 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:56.381267 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-bca64e92-9764-4016-bdc6-2ddc991fde04 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:56.545776 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-bca64e92-9764-4016-bdc6-2ddc991fde04 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:56.554823 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-bca64e92-9764-4016-bdc6-2ddc991fde04 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:56.556213 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-bca64e92-9764-4016-bdc6-2ddc991fde04 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:56.557380 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-bca64e92-9764-4016-bdc6-2ddc991fde04 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1673 microversion: 2.20 time: 0.197180 Sep 16 02:01:56.571608 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 373/733] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:01:56 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1673 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:01:57.584532 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-494bcdb8-2bdf-4347-9cc3-5b2f9bc4329a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:01:57.586325 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-494bcdb8-2bdf-4347-9cc3-5b2f9bc4329a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:01:57.593484 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-494bcdb8-2bdf-4347-9cc3-5b2f9bc4329a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:57.594069 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-494bcdb8-2bdf-4347-9cc3-5b2f9bc4329a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:57.594505 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-494bcdb8-2bdf-4347-9cc3-5b2f9bc4329a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:57.595234 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-494bcdb8-2bdf-4347-9cc3-5b2f9bc4329a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:57.595690 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-494bcdb8-2bdf-4347-9cc3-5b2f9bc4329a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:57.596290 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-494bcdb8-2bdf-4347-9cc3-5b2f9bc4329a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:57.696476 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-c1b3e5cb-00cd-4f11-9afe-c3bbe73d5582 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1697312919", "imageRef": "1546da04-912c-44c6-b4b9-34fba35e08f6", "flavorRef": "452", "networks": [{"uuid": "29a4b870-3f83-4eb0-9540-67d659221c2c"}]}} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:01:57.739036 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-494bcdb8-2bdf-4347-9cc3-5b2f9bc4329a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:57.748155 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-494bcdb8-2bdf-4347-9cc3-5b2f9bc4329a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:57.750216 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-494bcdb8-2bdf-4347-9cc3-5b2f9bc4329a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:57.751089 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-494bcdb8-2bdf-4347-9cc3-5b2f9bc4329a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1731 microversion: 2.20 time: 0.171990 Sep 16 02:01:57.760729 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 361/734] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:01:57 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1731 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:01:57.760898 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.network.neutron [None req-c1b3e5cb-00cd-4f11-9afe-c3bbe73d5582 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] validate_networks() for [('29a4b870-3f83-4eb0-9540-67d659221c2c', None, None, None, None, None)] {{(pid=120441) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 02:01:58.181650 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.virt.hardware [None req-c1b3e5cb-00cd-4f11-9afe-c3bbe73d5582 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Flavor limits 0:0:0 {{(pid=120441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 02:01:58.182264 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.virt.hardware [None req-c1b3e5cb-00cd-4f11-9afe-c3bbe73d5582 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Image limits 0:0:0 {{(pid=120441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 02:01:58.182926 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.virt.hardware [None req-c1b3e5cb-00cd-4f11-9afe-c3bbe73d5582 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Flavor pref 0:0:0 {{(pid=120441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 02:01:58.183489 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.virt.hardware [None req-c1b3e5cb-00cd-4f11-9afe-c3bbe73d5582 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Image pref 0:0:0 {{(pid=120441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 02:01:58.184103 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.virt.hardware [None req-c1b3e5cb-00cd-4f11-9afe-c3bbe73d5582 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 02:01:58.195911 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c1b3e5cb-00cd-4f11-9afe-c3bbe73d5582 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:58.196743 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c1b3e5cb-00cd-4f11-9afe-c3bbe73d5582 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:58.197352 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c1b3e5cb-00cd-4f11-9afe-c3bbe73d5582 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:58.198258 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c1b3e5cb-00cd-4f11-9afe-c3bbe73d5582 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:58.198899 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c1b3e5cb-00cd-4f11-9afe-c3bbe73d5582 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:58.199477 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c1b3e5cb-00cd-4f11-9afe-c3bbe73d5582 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:58.218189 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.quota [None req-c1b3e5cb-00cd-4f11-9afe-c3bbe73d5582 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Getting quotas for project 0b14dad85f52497c9819f0f3bb397f18. Resources: {'cores', 'ram', 'instances'} {{(pid=120441) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 02:01:58.222712 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.quota [None req-c1b3e5cb-00cd-4f11-9afe-c3bbe73d5582 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Getting quotas for user a14f57dd673f480c9984491a920fcacd and project 0b14dad85f52497c9819f0f3bb397f18. Resources: {'cores', 'ram', 'instances'} {{(pid=120441) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 02:01:58.235144 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-c1b3e5cb-00cd-4f11-9afe-c3bbe73d5582 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Going to run 1 instances... {{(pid=120441) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 02:01:58.238120 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-c1b3e5cb-00cd-4f11-9afe-c3bbe73d5582 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] [instance: 0171625e-3cb6-49d0-b5d6-d57409c02f47] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1546da04-912c-44c6-b4b9-34fba35e08f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120441) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 02:01:58.295685 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-c1b3e5cb-00cd-4f11-9afe-c3bbe73d5582 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.603307 Sep 16 02:01:58.297112 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 374/735] 10.222.0.42 () {60 vars in 1147 bytes} [Fri Sep 16 02:01:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 605 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 16 02:01:58.309252 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-d1a6bab9-4e48-4ffa-bd35-fceb965238b0 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:01:58.310223 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-d1a6bab9-4e48-4ffa-bd35-fceb965238b0 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] [instance: 0171625e-3cb6-49d0-b5d6-d57409c02f47] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:01:58.368384 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-d1a6bab9-4e48-4ffa-bd35-fceb965238b0 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14f57dd673f480c9984491a920fcacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b14dad85f52497c9819f0f3bb397f18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:58.377335 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-d1a6bab9-4e48-4ffa-bd35-fceb965238b0 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] 10.222.0.42 "GET /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47" status: 200 len: 1219 microversion: 2.1 time: 0.071415 Sep 16 02:01:58.378430 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 362/736] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:01:58 2022] GET /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47 => generated 1219 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:01:58.780362 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-9f508e7e-3112-4655-92c1-1a82547db741 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:01:58.781502 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-9f508e7e-3112-4655-92c1-1a82547db741 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:01:58.790681 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9f508e7e-3112-4655-92c1-1a82547db741 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:58.791427 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9f508e7e-3112-4655-92c1-1a82547db741 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:58.792179 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9f508e7e-3112-4655-92c1-1a82547db741 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:58.793021 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9f508e7e-3112-4655-92c1-1a82547db741 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:58.793698 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9f508e7e-3112-4655-92c1-1a82547db741 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:58.794287 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9f508e7e-3112-4655-92c1-1a82547db741 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:58.934568 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-9f508e7e-3112-4655-92c1-1a82547db741 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:58.943333 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-9f508e7e-3112-4655-92c1-1a82547db741 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:58.944983 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-9f508e7e-3112-4655-92c1-1a82547db741 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:58.946371 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-9f508e7e-3112-4655-92c1-1a82547db741 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1731 microversion: 2.20 time: 0.169868 Sep 16 02:01:58.946927 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 375/737] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:01:58 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:01:59.402128 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-40294f7f-ccfc-4a82-a7d2-75d5539ace38 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:01:59.402961 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-40294f7f-ccfc-4a82-a7d2-75d5539ace38 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] [instance: 0171625e-3cb6-49d0-b5d6-d57409c02f47] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:01:59.409465 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-40294f7f-ccfc-4a82-a7d2-75d5539ace38 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:59.410102 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-40294f7f-ccfc-4a82-a7d2-75d5539ace38 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:59.410694 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-40294f7f-ccfc-4a82-a7d2-75d5539ace38 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:59.411450 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-40294f7f-ccfc-4a82-a7d2-75d5539ace38 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:59.411993 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-40294f7f-ccfc-4a82-a7d2-75d5539ace38 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:59.412484 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-40294f7f-ccfc-4a82-a7d2-75d5539ace38 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:59.480354 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-40294f7f-ccfc-4a82-a7d2-75d5539ace38 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14f57dd673f480c9984491a920fcacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b14dad85f52497c9819f0f3bb397f18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:01:59.489763 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-40294f7f-ccfc-4a82-a7d2-75d5539ace38 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] 10.222.0.42 "GET /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47" status: 200 len: 1223 microversion: 2.1 time: 0.091267 Sep 16 02:01:59.490651 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 363/738] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:01:59 2022] GET /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47 => generated 1223 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:01:59.973010 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-30a27de1-c94e-4ae8-97e8-295adc568747 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:01:59.974173 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-30a27de1-c94e-4ae8-97e8-295adc568747 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:01:59.980599 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-30a27de1-c94e-4ae8-97e8-295adc568747 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:59.981311 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-30a27de1-c94e-4ae8-97e8-295adc568747 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:59.981897 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-30a27de1-c94e-4ae8-97e8-295adc568747 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:01:59.982808 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-30a27de1-c94e-4ae8-97e8-295adc568747 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:01:59.983755 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-30a27de1-c94e-4ae8-97e8-295adc568747 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:01:59.984409 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-30a27de1-c94e-4ae8-97e8-295adc568747 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:00.123186 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-30a27de1-c94e-4ae8-97e8-295adc568747 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:00.132401 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-30a27de1-c94e-4ae8-97e8-295adc568747 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:00.133899 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-30a27de1-c94e-4ae8-97e8-295adc568747 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:00.135052 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-30a27de1-c94e-4ae8-97e8-295adc568747 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1731 microversion: 2.20 time: 0.166614 Sep 16 02:02:00.135611 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 376/739] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:01:59 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1731 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:02:00.513722 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-2e2fb23a-3064-4781-87a0-6c8419d43f35 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:02:00.514375 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-2e2fb23a-3064-4781-87a0-6c8419d43f35 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] [instance: 0171625e-3cb6-49d0-b5d6-d57409c02f47] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:02:00.521701 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2e2fb23a-3064-4781-87a0-6c8419d43f35 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:00.522203 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2e2fb23a-3064-4781-87a0-6c8419d43f35 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:00.522641 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2e2fb23a-3064-4781-87a0-6c8419d43f35 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:00.523353 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2e2fb23a-3064-4781-87a0-6c8419d43f35 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:00.523813 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2e2fb23a-3064-4781-87a0-6c8419d43f35 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:00.524270 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2e2fb23a-3064-4781-87a0-6c8419d43f35 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:00.589610 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-2e2fb23a-3064-4781-87a0-6c8419d43f35 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14f57dd673f480c9984491a920fcacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b14dad85f52497c9819f0f3bb397f18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:00.597026 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-2e2fb23a-3064-4781-87a0-6c8419d43f35 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] 10.222.0.42 "GET /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47" status: 200 len: 1223 microversion: 2.1 time: 0.087252 Sep 16 02:02:00.597607 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 364/740] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:02:00 2022] GET /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47 => generated 1223 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:02:01.162505 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-8eaf91ef-2fa9-4e78-b251-4d4d042c35f3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:02:01.163098 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-8eaf91ef-2fa9-4e78-b251-4d4d042c35f3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:02:01.169671 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8eaf91ef-2fa9-4e78-b251-4d4d042c35f3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:01.170160 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8eaf91ef-2fa9-4e78-b251-4d4d042c35f3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:01.170596 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8eaf91ef-2fa9-4e78-b251-4d4d042c35f3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:01.171306 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8eaf91ef-2fa9-4e78-b251-4d4d042c35f3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:01.171757 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8eaf91ef-2fa9-4e78-b251-4d4d042c35f3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:01.172210 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8eaf91ef-2fa9-4e78-b251-4d4d042c35f3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:01.309086 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-8eaf91ef-2fa9-4e78-b251-4d4d042c35f3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:01.317471 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-8eaf91ef-2fa9-4e78-b251-4d4d042c35f3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:01.318896 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-8eaf91ef-2fa9-4e78-b251-4d4d042c35f3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:01.320065 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-8eaf91ef-2fa9-4e78-b251-4d4d042c35f3 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1731 microversion: 2.20 time: 0.162338 Sep 16 02:02:01.320618 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 377/741] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:02:01 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1731 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:02:01.620371 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-d33aca7a-89a5-4a79-b9b7-a83e8d60eeeb tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:02:01.620983 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-d33aca7a-89a5-4a79-b9b7-a83e8d60eeeb tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] [instance: 0171625e-3cb6-49d0-b5d6-d57409c02f47] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:02:01.627531 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d33aca7a-89a5-4a79-b9b7-a83e8d60eeeb tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:01.628057 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d33aca7a-89a5-4a79-b9b7-a83e8d60eeeb tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:01.628496 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d33aca7a-89a5-4a79-b9b7-a83e8d60eeeb tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:01.629272 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d33aca7a-89a5-4a79-b9b7-a83e8d60eeeb tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:01.629721 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d33aca7a-89a5-4a79-b9b7-a83e8d60eeeb tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:01.630151 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d33aca7a-89a5-4a79-b9b7-a83e8d60eeeb tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:01.693501 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-d33aca7a-89a5-4a79-b9b7-a83e8d60eeeb tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14f57dd673f480c9984491a920fcacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b14dad85f52497c9819f0f3bb397f18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:01.701235 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-d33aca7a-89a5-4a79-b9b7-a83e8d60eeeb tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] 10.222.0.42 "GET /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47" status: 200 len: 1223 microversion: 2.1 time: 0.084646 Sep 16 02:02:01.701807 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 365/742] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:02:01 2022] GET /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47 => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:02:02.346706 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-1910a4ab-77ee-4d26-a16b-553ec06bf9f8 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:02:02.347314 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-1910a4ab-77ee-4d26-a16b-553ec06bf9f8 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:02:02.354562 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1910a4ab-77ee-4d26-a16b-553ec06bf9f8 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:02.355041 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1910a4ab-77ee-4d26-a16b-553ec06bf9f8 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:02.355467 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1910a4ab-77ee-4d26-a16b-553ec06bf9f8 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:02.356180 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1910a4ab-77ee-4d26-a16b-553ec06bf9f8 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:02.356628 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1910a4ab-77ee-4d26-a16b-553ec06bf9f8 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:02.357046 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1910a4ab-77ee-4d26-a16b-553ec06bf9f8 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:02.501732 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-1910a4ab-77ee-4d26-a16b-553ec06bf9f8 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:02.510289 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-1910a4ab-77ee-4d26-a16b-553ec06bf9f8 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:02.511710 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-1910a4ab-77ee-4d26-a16b-553ec06bf9f8 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:02.512890 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-1910a4ab-77ee-4d26-a16b-553ec06bf9f8 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1731 microversion: 2.20 time: 0.170060 Sep 16 02:02:02.513472 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 378/743] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:02:02 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1731 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:02:02.725233 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-18d551b9-53fa-43c1-8f96-b2ede5a488b9 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:02:02.725869 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-18d551b9-53fa-43c1-8f96-b2ede5a488b9 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] [instance: 0171625e-3cb6-49d0-b5d6-d57409c02f47] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:02:02.732142 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-18d551b9-53fa-43c1-8f96-b2ede5a488b9 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:02.732641 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-18d551b9-53fa-43c1-8f96-b2ede5a488b9 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:02.733068 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-18d551b9-53fa-43c1-8f96-b2ede5a488b9 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:02.733832 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-18d551b9-53fa-43c1-8f96-b2ede5a488b9 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:02.734293 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-18d551b9-53fa-43c1-8f96-b2ede5a488b9 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:02.734715 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-18d551b9-53fa-43c1-8f96-b2ede5a488b9 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:02.808546 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-18d551b9-53fa-43c1-8f96-b2ede5a488b9 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14f57dd673f480c9984491a920fcacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b14dad85f52497c9819f0f3bb397f18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:02.815855 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-18d551b9-53fa-43c1-8f96-b2ede5a488b9 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] 10.222.0.42 "GET /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47" status: 200 len: 1223 microversion: 2.1 time: 0.094692 Sep 16 02:02:02.817488 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 366/744] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:02:02 2022] GET /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47 => generated 1223 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:02:03.540818 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-a7ff0be3-0b65-48a2-a6aa-e13651a49eb4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:02:03.541520 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-a7ff0be3-0b65-48a2-a6aa-e13651a49eb4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:02:03.548590 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a7ff0be3-0b65-48a2-a6aa-e13651a49eb4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:03.549080 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a7ff0be3-0b65-48a2-a6aa-e13651a49eb4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:03.549515 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a7ff0be3-0b65-48a2-a6aa-e13651a49eb4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:03.550251 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a7ff0be3-0b65-48a2-a6aa-e13651a49eb4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:03.551291 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a7ff0be3-0b65-48a2-a6aa-e13651a49eb4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:03.551722 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a7ff0be3-0b65-48a2-a6aa-e13651a49eb4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:03.685461 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-a7ff0be3-0b65-48a2-a6aa-e13651a49eb4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:03.694335 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-a7ff0be3-0b65-48a2-a6aa-e13651a49eb4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:03.695757 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-a7ff0be3-0b65-48a2-a6aa-e13651a49eb4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:03.696955 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-a7ff0be3-0b65-48a2-a6aa-e13651a49eb4 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1731 microversion: 2.20 time: 0.161215 Sep 16 02:02:03.697508 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 379/745] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:02:03 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1731 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:02:03.838860 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-667ace1e-aa70-47aa-b6d4-a7a25cd6cfa2 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:02:03.839469 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-667ace1e-aa70-47aa-b6d4-a7a25cd6cfa2 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] [instance: 0171625e-3cb6-49d0-b5d6-d57409c02f47] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:02:03.846605 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-667ace1e-aa70-47aa-b6d4-a7a25cd6cfa2 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:03.847090 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-667ace1e-aa70-47aa-b6d4-a7a25cd6cfa2 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:03.848137 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-667ace1e-aa70-47aa-b6d4-a7a25cd6cfa2 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:03.849245 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-667ace1e-aa70-47aa-b6d4-a7a25cd6cfa2 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:03.849704 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-667ace1e-aa70-47aa-b6d4-a7a25cd6cfa2 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:03.850130 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-667ace1e-aa70-47aa-b6d4-a7a25cd6cfa2 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:03.914940 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-667ace1e-aa70-47aa-b6d4-a7a25cd6cfa2 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14f57dd673f480c9984491a920fcacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b14dad85f52497c9819f0f3bb397f18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:03.922692 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-667ace1e-aa70-47aa-b6d4-a7a25cd6cfa2 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] 10.222.0.42 "GET /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47" status: 200 len: 1223 microversion: 2.1 time: 0.087680 Sep 16 02:02:03.923459 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 367/746] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:02:03 2022] GET /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47 => generated 1223 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:02:04.723306 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-64de4bb0-6c7e-4450-a439-15fb318e74f1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:02:04.723991 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-64de4bb0-6c7e-4450-a439-15fb318e74f1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:02:04.730579 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-64de4bb0-6c7e-4450-a439-15fb318e74f1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:04.731066 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-64de4bb0-6c7e-4450-a439-15fb318e74f1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:04.731507 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-64de4bb0-6c7e-4450-a439-15fb318e74f1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:04.732236 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-64de4bb0-6c7e-4450-a439-15fb318e74f1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:04.732694 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-64de4bb0-6c7e-4450-a439-15fb318e74f1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:04.733129 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-64de4bb0-6c7e-4450-a439-15fb318e74f1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:04.901441 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-64de4bb0-6c7e-4450-a439-15fb318e74f1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:04.910667 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-64de4bb0-6c7e-4450-a439-15fb318e74f1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:04.912426 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-64de4bb0-6c7e-4450-a439-15fb318e74f1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:04.913614 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-64de4bb0-6c7e-4450-a439-15fb318e74f1 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1731 microversion: 2.20 time: 0.194979 Sep 16 02:02:04.914737 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 380/747] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:02:04 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1731 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:02:04.946372 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-4f3c8906-7e97-419e-80e3-f82170be6878 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:02:04.947731 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-4f3c8906-7e97-419e-80e3-f82170be6878 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] [instance: 0171625e-3cb6-49d0-b5d6-d57409c02f47] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:02:04.954952 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-4f3c8906-7e97-419e-80e3-f82170be6878 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:04.955526 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-4f3c8906-7e97-419e-80e3-f82170be6878 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:04.956557 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-4f3c8906-7e97-419e-80e3-f82170be6878 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:04.957716 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-4f3c8906-7e97-419e-80e3-f82170be6878 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:04.958921 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-4f3c8906-7e97-419e-80e3-f82170be6878 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:04.959460 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-4f3c8906-7e97-419e-80e3-f82170be6878 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:05.024677 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-4f3c8906-7e97-419e-80e3-f82170be6878 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14f57dd673f480c9984491a920fcacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b14dad85f52497c9819f0f3bb397f18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:05.032860 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-4f3c8906-7e97-419e-80e3-f82170be6878 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] 10.222.0.42 "GET /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47" status: 200 len: 1223 microversion: 2.1 time: 0.090741 Sep 16 02:02:05.033519 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 368/748] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:02:04 2022] GET /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47 => generated 1223 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:02:05.940419 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-2aeb106e-31ef-4727-ae7a-d7dcc882689a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:02:05.941676 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-2aeb106e-31ef-4727-ae7a-d7dcc882689a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:02:05.949538 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2aeb106e-31ef-4727-ae7a-d7dcc882689a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:05.950085 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2aeb106e-31ef-4727-ae7a-d7dcc882689a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:05.950519 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2aeb106e-31ef-4727-ae7a-d7dcc882689a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:05.951214 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2aeb106e-31ef-4727-ae7a-d7dcc882689a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:05.951671 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2aeb106e-31ef-4727-ae7a-d7dcc882689a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:05.952120 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2aeb106e-31ef-4727-ae7a-d7dcc882689a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:06.057700 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-66c72901-1992-4c59-aeb0-8d1e6572f557 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:02:06.058380 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-66c72901-1992-4c59-aeb0-8d1e6572f557 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] [instance: 0171625e-3cb6-49d0-b5d6-d57409c02f47] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:02:06.065095 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-66c72901-1992-4c59-aeb0-8d1e6572f557 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:06.065576 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-66c72901-1992-4c59-aeb0-8d1e6572f557 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:06.066942 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-66c72901-1992-4c59-aeb0-8d1e6572f557 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:06.067648 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-66c72901-1992-4c59-aeb0-8d1e6572f557 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:06.068135 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-66c72901-1992-4c59-aeb0-8d1e6572f557 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:06.068555 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-66c72901-1992-4c59-aeb0-8d1e6572f557 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:06.114563 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-2aeb106e-31ef-4727-ae7a-d7dcc882689a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:06.122574 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-2aeb106e-31ef-4727-ae7a-d7dcc882689a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:06.124047 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-2aeb106e-31ef-4727-ae7a-d7dcc882689a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:06.125229 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-2aeb106e-31ef-4727-ae7a-d7dcc882689a tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1731 microversion: 2.20 time: 0.188987 Sep 16 02:02:06.136507 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 381/749] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:02:05 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1731 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:02:06.141997 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-66c72901-1992-4c59-aeb0-8d1e6572f557 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14f57dd673f480c9984491a920fcacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b14dad85f52497c9819f0f3bb397f18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:06.150142 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-66c72901-1992-4c59-aeb0-8d1e6572f557 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] 10.222.0.42 "GET /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47" status: 200 len: 1223 microversion: 2.1 time: 0.096409 Sep 16 02:02:06.150722 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 369/750] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:02:06 2022] GET /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47 => generated 1223 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:02:07.151648 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-ecb4f71d-ee87-404f-81ed-13d1fd6fe210 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:02:07.152288 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-ecb4f71d-ee87-404f-81ed-13d1fd6fe210 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:02:07.158573 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ecb4f71d-ee87-404f-81ed-13d1fd6fe210 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:07.159077 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ecb4f71d-ee87-404f-81ed-13d1fd6fe210 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:07.159511 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ecb4f71d-ee87-404f-81ed-13d1fd6fe210 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:07.160913 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ecb4f71d-ee87-404f-81ed-13d1fd6fe210 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:07.161364 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ecb4f71d-ee87-404f-81ed-13d1fd6fe210 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:07.161785 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ecb4f71d-ee87-404f-81ed-13d1fd6fe210 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:07.173042 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-3e6af084-7b66-41f2-bd21-0c2624233284 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:02:07.173639 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-3e6af084-7b66-41f2-bd21-0c2624233284 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] [instance: 0171625e-3cb6-49d0-b5d6-d57409c02f47] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:02:07.181119 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3e6af084-7b66-41f2-bd21-0c2624233284 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:07.181602 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3e6af084-7b66-41f2-bd21-0c2624233284 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:07.182034 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3e6af084-7b66-41f2-bd21-0c2624233284 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:07.182715 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3e6af084-7b66-41f2-bd21-0c2624233284 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:07.183168 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3e6af084-7b66-41f2-bd21-0c2624233284 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:07.183586 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3e6af084-7b66-41f2-bd21-0c2624233284 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:07.244988 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-3e6af084-7b66-41f2-bd21-0c2624233284 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14f57dd673f480c9984491a920fcacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b14dad85f52497c9819f0f3bb397f18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:07.247278 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:02:07.254171 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-3e6af084-7b66-41f2-bd21-0c2624233284 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] 10.222.0.42 "GET /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47" status: 200 len: 1223 microversion: 2.1 time: 0.084913 Sep 16 02:02:07.254749 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 370/751] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:02:07 2022] GET /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47 => generated 1223 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 02:02:07.291776 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-ecb4f71d-ee87-404f-81ed-13d1fd6fe210 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:07.299877 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-ecb4f71d-ee87-404f-81ed-13d1fd6fe210 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:07.302233 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-ecb4f71d-ee87-404f-81ed-13d1fd6fe210 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:07.303372 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-ecb4f71d-ee87-404f-81ed-13d1fd6fe210 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1731 microversion: 2.20 time: 0.155566 Sep 16 02:02:07.303922 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 382/752] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:02:07 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1731 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:02:08.276252 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-d3e0b21f-70f2-44de-8766-b7343cdfd0ea tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:02:08.276792 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-d3e0b21f-70f2-44de-8766-b7343cdfd0ea tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] [instance: 0171625e-3cb6-49d0-b5d6-d57409c02f47] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:02:08.284124 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d3e0b21f-70f2-44de-8766-b7343cdfd0ea tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:08.284597 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d3e0b21f-70f2-44de-8766-b7343cdfd0ea tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:08.285033 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d3e0b21f-70f2-44de-8766-b7343cdfd0ea tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:08.286194 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d3e0b21f-70f2-44de-8766-b7343cdfd0ea tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:08.286645 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d3e0b21f-70f2-44de-8766-b7343cdfd0ea tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:08.287065 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d3e0b21f-70f2-44de-8766-b7343cdfd0ea tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:08.328144 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-50b9f259-f7a6-4585-8920-4f90d13058fb tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:02:08.328758 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-50b9f259-f7a6-4585-8920-4f90d13058fb tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:02:08.331008 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell0:SELECT=2 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:02:08.331665 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell0:SELECT=6 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:02:08.337685 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-50b9f259-f7a6-4585-8920-4f90d13058fb tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:08.338172 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-50b9f259-f7a6-4585-8920-4f90d13058fb tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:08.338610 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-50b9f259-f7a6-4585-8920-4f90d13058fb tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:08.339298 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-50b9f259-f7a6-4585-8920-4f90d13058fb tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:08.339749 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-50b9f259-f7a6-4585-8920-4f90d13058fb tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:08.340195 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-50b9f259-f7a6-4585-8920-4f90d13058fb tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:08.347621 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-d3e0b21f-70f2-44de-8766-b7343cdfd0ea tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14f57dd673f480c9984491a920fcacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b14dad85f52497c9819f0f3bb397f18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:08.355161 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-d3e0b21f-70f2-44de-8766-b7343cdfd0ea tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] 10.222.0.42 "GET /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47" status: 200 len: 1223 microversion: 2.1 time: 0.082830 Sep 16 02:02:08.355733 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 371/753] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:02:08 2022] GET /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47 => generated 1223 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:02:08.476780 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-50b9f259-f7a6-4585-8920-4f90d13058fb tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:08.480129 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=2,nova_cell1:UPDATE=4 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:02:08.485511 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-50b9f259-f7a6-4585-8920-4f90d13058fb tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:08.486959 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-50b9f259-f7a6-4585-8920-4f90d13058fb tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:08.488145 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-50b9f259-f7a6-4585-8920-4f90d13058fb tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1731 microversion: 2.20 time: 0.163815 Sep 16 02:02:08.488705 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 383/754] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:02:08 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1731 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 02:02:09.378866 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-f8c125ff-6e6c-4101-a95f-8c8a530dbf8e tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:02:09.379451 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-f8c125ff-6e6c-4101-a95f-8c8a530dbf8e tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] [instance: 0171625e-3cb6-49d0-b5d6-d57409c02f47] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:02:09.381847 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell0:SELECT=2 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:02:09.387442 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f8c125ff-6e6c-4101-a95f-8c8a530dbf8e tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:09.387929 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f8c125ff-6e6c-4101-a95f-8c8a530dbf8e tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:09.388452 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f8c125ff-6e6c-4101-a95f-8c8a530dbf8e tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:09.389140 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f8c125ff-6e6c-4101-a95f-8c8a530dbf8e tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:09.389591 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f8c125ff-6e6c-4101-a95f-8c8a530dbf8e tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:09.390013 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f8c125ff-6e6c-4101-a95f-8c8a530dbf8e tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:09.452753 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-f8c125ff-6e6c-4101-a95f-8c8a530dbf8e tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14f57dd673f480c9984491a920fcacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b14dad85f52497c9819f0f3bb397f18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:09.460795 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-f8c125ff-6e6c-4101-a95f-8c8a530dbf8e tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] 10.222.0.42 "GET /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47" status: 200 len: 1223 microversion: 2.1 time: 0.086049 Sep 16 02:02:09.461352 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 372/755] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:02:09 2022] GET /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47 => generated 1223 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 02:02:09.516285 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-0d696cbb-7b97-4062-9622-2de9cafb5271 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:02:09.516895 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-0d696cbb-7b97-4062-9622-2de9cafb5271 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:02:09.524572 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0d696cbb-7b97-4062-9622-2de9cafb5271 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:09.525054 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0d696cbb-7b97-4062-9622-2de9cafb5271 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:09.525495 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0d696cbb-7b97-4062-9622-2de9cafb5271 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:09.526178 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0d696cbb-7b97-4062-9622-2de9cafb5271 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:09.526627 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0d696cbb-7b97-4062-9622-2de9cafb5271 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:09.527049 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0d696cbb-7b97-4062-9622-2de9cafb5271 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:09.654563 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-0d696cbb-7b97-4062-9622-2de9cafb5271 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:09.662855 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-0d696cbb-7b97-4062-9622-2de9cafb5271 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:09.664310 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-0d696cbb-7b97-4062-9622-2de9cafb5271 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:09.665442 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-0d696cbb-7b97-4062-9622-2de9cafb5271 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1731 microversion: 2.20 time: 0.154152 Sep 16 02:02:09.665993 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 384/756] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:02:09 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:02:10.487803 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-ca7e1fee-ced2-4d32-8f91-b30ffbecf2b9 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:02:10.488489 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-ca7e1fee-ced2-4d32-8f91-b30ffbecf2b9 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] [instance: 0171625e-3cb6-49d0-b5d6-d57409c02f47] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:02:10.496900 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ca7e1fee-ced2-4d32-8f91-b30ffbecf2b9 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:10.497465 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ca7e1fee-ced2-4d32-8f91-b30ffbecf2b9 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:10.497699 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ca7e1fee-ced2-4d32-8f91-b30ffbecf2b9 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:10.498401 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ca7e1fee-ced2-4d32-8f91-b30ffbecf2b9 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:10.498856 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ca7e1fee-ced2-4d32-8f91-b30ffbecf2b9 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:10.499281 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ca7e1fee-ced2-4d32-8f91-b30ffbecf2b9 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:10.576490 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-ca7e1fee-ced2-4d32-8f91-b30ffbecf2b9 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14f57dd673f480c9984491a920fcacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b14dad85f52497c9819f0f3bb397f18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:10.589467 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-ca7e1fee-ced2-4d32-8f91-b30ffbecf2b9 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] 10.222.0.42 "GET /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47" status: 200 len: 1223 microversion: 2.1 time: 0.105442 Sep 16 02:02:10.590767 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 373/757] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:02:10 2022] GET /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47 => generated 1223 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:02:10.692353 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-3d4cd256-ce28-49ae-ad76-db69d4182016 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:02:10.692957 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-3d4cd256-ce28-49ae-ad76-db69d4182016 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:02:10.699375 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3d4cd256-ce28-49ae-ad76-db69d4182016 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:10.699859 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3d4cd256-ce28-49ae-ad76-db69d4182016 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:10.700313 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3d4cd256-ce28-49ae-ad76-db69d4182016 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:10.701006 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3d4cd256-ce28-49ae-ad76-db69d4182016 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:10.701453 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3d4cd256-ce28-49ae-ad76-db69d4182016 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:10.701870 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3d4cd256-ce28-49ae-ad76-db69d4182016 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:10.831392 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-3d4cd256-ce28-49ae-ad76-db69d4182016 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:10.840097 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-3d4cd256-ce28-49ae-ad76-db69d4182016 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:10.841538 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-3d4cd256-ce28-49ae-ad76-db69d4182016 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:10.842678 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-3d4cd256-ce28-49ae-ad76-db69d4182016 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1731 microversion: 2.20 time: 0.154244 Sep 16 02:02:10.843238 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 385/758] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:02:10 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:02:11.613294 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-cdd5adeb-9f5f-4fe7-93de-f3b8d57a870b tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:02:11.613912 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-cdd5adeb-9f5f-4fe7-93de-f3b8d57a870b tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] [instance: 0171625e-3cb6-49d0-b5d6-d57409c02f47] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:02:11.621200 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cdd5adeb-9f5f-4fe7-93de-f3b8d57a870b tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:11.621690 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cdd5adeb-9f5f-4fe7-93de-f3b8d57a870b tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:11.622125 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cdd5adeb-9f5f-4fe7-93de-f3b8d57a870b tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:11.622816 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cdd5adeb-9f5f-4fe7-93de-f3b8d57a870b tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:11.623270 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cdd5adeb-9f5f-4fe7-93de-f3b8d57a870b tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:11.623694 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cdd5adeb-9f5f-4fe7-93de-f3b8d57a870b tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:11.683525 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-cdd5adeb-9f5f-4fe7-93de-f3b8d57a870b tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14f57dd673f480c9984491a920fcacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b14dad85f52497c9819f0f3bb397f18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:11.691004 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-cdd5adeb-9f5f-4fe7-93de-f3b8d57a870b tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] 10.222.0.42 "GET /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47" status: 200 len: 1223 microversion: 2.1 time: 0.081560 Sep 16 02:02:11.691571 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 374/759] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:02:11 2022] GET /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47 => generated 1223 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:02:11.868965 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-ab073944-605f-4ed7-b052-aa39029b61e6 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:02:11.869493 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-ab073944-605f-4ed7-b052-aa39029b61e6 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:02:11.875810 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ab073944-605f-4ed7-b052-aa39029b61e6 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:11.876642 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ab073944-605f-4ed7-b052-aa39029b61e6 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:11.877024 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ab073944-605f-4ed7-b052-aa39029b61e6 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:11.877703 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ab073944-605f-4ed7-b052-aa39029b61e6 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:11.878556 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ab073944-605f-4ed7-b052-aa39029b61e6 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:11.878698 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ab073944-605f-4ed7-b052-aa39029b61e6 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:12.056314 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-ab073944-605f-4ed7-b052-aa39029b61e6 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:12.065235 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-ab073944-605f-4ed7-b052-aa39029b61e6 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:12.066687 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-ab073944-605f-4ed7-b052-aa39029b61e6 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:12.068531 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-ab073944-605f-4ed7-b052-aa39029b61e6 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1731 microversion: 2.20 time: 0.203847 Sep 16 02:02:12.069134 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 386/760] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:02:11 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1731 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:02:12.714185 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-814ab5f5-6c21-49d9-b7ab-19419c07f842 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:02:12.714760 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-814ab5f5-6c21-49d9-b7ab-19419c07f842 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] [instance: 0171625e-3cb6-49d0-b5d6-d57409c02f47] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:02:12.721074 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-814ab5f5-6c21-49d9-b7ab-19419c07f842 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:12.721550 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-814ab5f5-6c21-49d9-b7ab-19419c07f842 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:12.721983 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-814ab5f5-6c21-49d9-b7ab-19419c07f842 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:12.722677 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-814ab5f5-6c21-49d9-b7ab-19419c07f842 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:12.723125 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-814ab5f5-6c21-49d9-b7ab-19419c07f842 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:12.723542 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-814ab5f5-6c21-49d9-b7ab-19419c07f842 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:12.784823 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-814ab5f5-6c21-49d9-b7ab-19419c07f842 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14f57dd673f480c9984491a920fcacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b14dad85f52497c9819f0f3bb397f18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:12.792989 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-814ab5f5-6c21-49d9-b7ab-19419c07f842 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] 10.222.0.42 "GET /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47" status: 200 len: 1271 microversion: 2.1 time: 0.082738 Sep 16 02:02:12.793570 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 375/761] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:02:12 2022] GET /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47 => generated 1271 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 02:02:13.094249 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-bb5cb01c-261d-4d7a-a192-610b7ee094af tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:02:13.094802 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-bb5cb01c-261d-4d7a-a192-610b7ee094af tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:02:13.101886 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-bb5cb01c-261d-4d7a-a192-610b7ee094af tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:13.102367 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-bb5cb01c-261d-4d7a-a192-610b7ee094af tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:13.102799 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-bb5cb01c-261d-4d7a-a192-610b7ee094af tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:13.103481 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-bb5cb01c-261d-4d7a-a192-610b7ee094af tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:13.103953 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-bb5cb01c-261d-4d7a-a192-610b7ee094af tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:13.104377 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-bb5cb01c-261d-4d7a-a192-610b7ee094af tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:13.328701 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-bb5cb01c-261d-4d7a-a192-610b7ee094af tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:13.337426 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-bb5cb01c-261d-4d7a-a192-610b7ee094af tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:13.338900 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-bb5cb01c-261d-4d7a-a192-610b7ee094af tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:13.340094 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-bb5cb01c-261d-4d7a-a192-610b7ee094af tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1731 microversion: 2.20 time: 0.249819 Sep 16 02:02:13.340640 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 387/762] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:02:13 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1731 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:02:13.816246 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-60358eb4-d871-436e-9674-7f53e87482a1 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:02:13.816863 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-60358eb4-d871-436e-9674-7f53e87482a1 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] [instance: 0171625e-3cb6-49d0-b5d6-d57409c02f47] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:02:13.823858 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-60358eb4-d871-436e-9674-7f53e87482a1 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:13.824402 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-60358eb4-d871-436e-9674-7f53e87482a1 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:13.824819 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-60358eb4-d871-436e-9674-7f53e87482a1 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:13.825716 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-60358eb4-d871-436e-9674-7f53e87482a1 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:13.826175 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-60358eb4-d871-436e-9674-7f53e87482a1 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:13.826794 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-60358eb4-d871-436e-9674-7f53e87482a1 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:13.964390 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-60358eb4-d871-436e-9674-7f53e87482a1 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14f57dd673f480c9984491a920fcacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b14dad85f52497c9819f0f3bb397f18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:13.972379 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-60358eb4-d871-436e-9674-7f53e87482a1 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] 10.222.0.42 "GET /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47" status: 200 len: 1319 microversion: 2.1 time: 0.160005 Sep 16 02:02:13.972951 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 376/763] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:02:13 2022] GET /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47 => generated 1319 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:02:14.367139 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-e811e3ef-08f2-490f-8af7-714aab0bac8d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:02:14.367765 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-e811e3ef-08f2-490f-8af7-714aab0bac8d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:02:14.374489 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e811e3ef-08f2-490f-8af7-714aab0bac8d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:14.374976 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e811e3ef-08f2-490f-8af7-714aab0bac8d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:14.375412 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e811e3ef-08f2-490f-8af7-714aab0bac8d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:14.376406 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e811e3ef-08f2-490f-8af7-714aab0bac8d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:14.376863 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e811e3ef-08f2-490f-8af7-714aab0bac8d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:14.377282 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e811e3ef-08f2-490f-8af7-714aab0bac8d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:14.648662 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-e811e3ef-08f2-490f-8af7-714aab0bac8d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:14.656787 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-e811e3ef-08f2-490f-8af7-714aab0bac8d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:14.658233 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-e811e3ef-08f2-490f-8af7-714aab0bac8d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:14.659386 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-e811e3ef-08f2-490f-8af7-714aab0bac8d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1731 microversion: 2.20 time: 0.296885 Sep 16 02:02:14.659954 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 388/764] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:02:14 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1731 bytes in 298 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:02:14.901969 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [req-07f386b4-8cad-4438-bc72-3e55bfcc69f0 req-3eb6d6ef-ba48-476d-b776-89284a9b72c7 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "0171625e-3cb6-49d0-b5d6-d57409c02f47", "tag": "e2410910-0726-4839-b0cf-ae84d00a85c2"}]} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:02:14.914697 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-07f386b4-8cad-4438-bc72-3e55bfcc69f0 req-3eb6d6ef-ba48-476d-b776-89284a9b72c7 service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:14.915361 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-07f386b4-8cad-4438-bc72-3e55bfcc69f0 req-3eb6d6ef-ba48-476d-b776-89284a9b72c7 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:14.916028 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-07f386b4-8cad-4438-bc72-3e55bfcc69f0 req-3eb6d6ef-ba48-476d-b776-89284a9b72c7 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:14.929538 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.compute.server_external_events [req-07f386b4-8cad-4438-bc72-3e55bfcc69f0 req-3eb6d6ef-ba48-476d-b776-89284a9b72c7 service nova] Creating event network-changed:e2410910-0726-4839-b0cf-ae84d00a85c2 for instance 0171625e-3cb6-49d0-b5d6-d57409c02f47 on hv-cinder-84914 Sep 16 02:02:14.934718 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [req-07f386b4-8cad-4438-bc72-3e55bfcc69f0 req-3eb6d6ef-ba48-476d-b776-89284a9b72c7 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036683 Sep 16 02:02:14.935534 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 377/765] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:02:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 02:02:14.995078 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-db46f3a2-080b-42b9-9a38-c87bea2f37b2 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:02:14.995736 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-db46f3a2-080b-42b9-9a38-c87bea2f37b2 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] [instance: 0171625e-3cb6-49d0-b5d6-d57409c02f47] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:02:15.001832 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-db46f3a2-080b-42b9-9a38-c87bea2f37b2 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:15.002318 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-db46f3a2-080b-42b9-9a38-c87bea2f37b2 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:15.002761 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-db46f3a2-080b-42b9-9a38-c87bea2f37b2 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:15.003452 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-db46f3a2-080b-42b9-9a38-c87bea2f37b2 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:15.003887 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-db46f3a2-080b-42b9-9a38-c87bea2f37b2 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:15.004340 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-db46f3a2-080b-42b9-9a38-c87bea2f37b2 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:15.231538 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-db46f3a2-080b-42b9-9a38-c87bea2f37b2 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14f57dd673f480c9984491a920fcacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b14dad85f52497c9819f0f3bb397f18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:15.239184 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-db46f3a2-080b-42b9-9a38-c87bea2f37b2 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] 10.222.0.42 "GET /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47" status: 200 len: 1319 microversion: 2.1 time: 0.247997 Sep 16 02:02:15.240033 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 389/766] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:02:14 2022] GET /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47 => generated 1319 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:02:15.584906 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [req-0f7ce663-7d89-48fd-bb2b-9a07700be70a req-f5a72d5d-f936-42e9-bbaa-7de556a2e01a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3582769d-4f26-4b4d-b2d9-e9638db93366", "name": "network-vif-plugged", "status": "completed", "tag": "4127457c-ae36-44e0-abd0-2ee3fefef488"}]} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:02:15.595574 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-0f7ce663-7d89-48fd-bb2b-9a07700be70a req-f5a72d5d-f936-42e9-bbaa-7de556a2e01a service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:15.596117 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-0f7ce663-7d89-48fd-bb2b-9a07700be70a req-f5a72d5d-f936-42e9-bbaa-7de556a2e01a service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:15.596540 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-0f7ce663-7d89-48fd-bb2b-9a07700be70a req-f5a72d5d-f936-42e9-bbaa-7de556a2e01a service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:15.608057 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.compute.server_external_events [req-0f7ce663-7d89-48fd-bb2b-9a07700be70a req-f5a72d5d-f936-42e9-bbaa-7de556a2e01a service nova] Creating event network-vif-plugged:4127457c-ae36-44e0-abd0-2ee3fefef488 for instance 3582769d-4f26-4b4d-b2d9-e9638db93366 on hv-cinder-84914 Sep 16 02:02:15.612887 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [req-0f7ce663-7d89-48fd-bb2b-9a07700be70a req-f5a72d5d-f936-42e9-bbaa-7de556a2e01a service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032686 Sep 16 02:02:15.613466 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 378/767] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:02:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:02:15.686074 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-c1d48173-62c1-4975-bdf0-0962ac2730f5 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:02:15.686683 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-c1d48173-62c1-4975-bdf0-0962ac2730f5 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:02:15.693811 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c1d48173-62c1-4975-bdf0-0962ac2730f5 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:15.694288 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c1d48173-62c1-4975-bdf0-0962ac2730f5 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:15.694726 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c1d48173-62c1-4975-bdf0-0962ac2730f5 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:15.695412 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c1d48173-62c1-4975-bdf0-0962ac2730f5 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:15.695875 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c1d48173-62c1-4975-bdf0-0962ac2730f5 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:15.696319 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c1d48173-62c1-4975-bdf0-0962ac2730f5 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:15.824657 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-c1d48173-62c1-4975-bdf0-0962ac2730f5 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:15.832743 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-c1d48173-62c1-4975-bdf0-0962ac2730f5 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:15.834338 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-c1d48173-62c1-4975-bdf0-0962ac2730f5 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:15.835490 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-c1d48173-62c1-4975-bdf0-0962ac2730f5 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1731 microversion: 2.20 time: 0.153663 Sep 16 02:02:15.836075 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 390/768] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:02:15 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1731 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:02:16.263233 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-d7628ebf-f002-4b3c-a630-5d8e8cc2a908 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:02:16.263925 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-d7628ebf-f002-4b3c-a630-5d8e8cc2a908 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] [instance: 0171625e-3cb6-49d0-b5d6-d57409c02f47] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:02:16.270395 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d7628ebf-f002-4b3c-a630-5d8e8cc2a908 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:16.271018 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d7628ebf-f002-4b3c-a630-5d8e8cc2a908 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:16.271453 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d7628ebf-f002-4b3c-a630-5d8e8cc2a908 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:16.272162 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d7628ebf-f002-4b3c-a630-5d8e8cc2a908 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:16.272611 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d7628ebf-f002-4b3c-a630-5d8e8cc2a908 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:16.273036 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d7628ebf-f002-4b3c-a630-5d8e8cc2a908 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:16.399133 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-d7628ebf-f002-4b3c-a630-5d8e8cc2a908 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14f57dd673f480c9984491a920fcacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b14dad85f52497c9819f0f3bb397f18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:16.406607 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-d7628ebf-f002-4b3c-a630-5d8e8cc2a908 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] 10.222.0.42 "GET /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47" status: 200 len: 1319 microversion: 2.1 time: 0.147567 Sep 16 02:02:16.407167 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 379/769] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:02:16 2022] GET /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47 => generated 1319 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:02:16.860779 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-7a302719-8326-47f4-a2e3-9ebebfe9acd9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:02:16.861415 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-7a302719-8326-47f4-a2e3-9ebebfe9acd9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:02:16.867799 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7a302719-8326-47f4-a2e3-9ebebfe9acd9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:16.868332 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7a302719-8326-47f4-a2e3-9ebebfe9acd9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:16.868763 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7a302719-8326-47f4-a2e3-9ebebfe9acd9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:16.869437 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7a302719-8326-47f4-a2e3-9ebebfe9acd9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:16.869890 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7a302719-8326-47f4-a2e3-9ebebfe9acd9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:16.870303 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7a302719-8326-47f4-a2e3-9ebebfe9acd9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:17.002265 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-7a302719-8326-47f4-a2e3-9ebebfe9acd9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:17.010652 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-7a302719-8326-47f4-a2e3-9ebebfe9acd9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:17.012123 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-7a302719-8326-47f4-a2e3-9ebebfe9acd9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:17.013275 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-7a302719-8326-47f4-a2e3-9ebebfe9acd9 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1731 microversion: 2.20 time: 0.156374 Sep 16 02:02:17.013831 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 391/770] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:02:16 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1731 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:02:17.430558 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-03e01542-7d2b-4288-addd-bb6a1d63a28a tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:02:17.431175 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-03e01542-7d2b-4288-addd-bb6a1d63a28a tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] [instance: 0171625e-3cb6-49d0-b5d6-d57409c02f47] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:02:17.437549 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-03e01542-7d2b-4288-addd-bb6a1d63a28a tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:17.438034 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-03e01542-7d2b-4288-addd-bb6a1d63a28a tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:17.438468 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-03e01542-7d2b-4288-addd-bb6a1d63a28a tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:17.439169 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-03e01542-7d2b-4288-addd-bb6a1d63a28a tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:17.439622 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-03e01542-7d2b-4288-addd-bb6a1d63a28a tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:17.440072 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-03e01542-7d2b-4288-addd-bb6a1d63a28a tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:17.582829 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-03e01542-7d2b-4288-addd-bb6a1d63a28a tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14f57dd673f480c9984491a920fcacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b14dad85f52497c9819f0f3bb397f18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:17.590867 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-03e01542-7d2b-4288-addd-bb6a1d63a28a tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] 10.222.0.42 "GET /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47" status: 200 len: 1319 microversion: 2.1 time: 0.164658 Sep 16 02:02:17.591443 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 380/771] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:02:17 2022] GET /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47 => generated 1319 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:02:18.039038 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-f3c8c12d-c9b6-4d83-b012-066550ae1acc tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:02:18.039554 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-f3c8c12d-c9b6-4d83-b012-066550ae1acc tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:02:18.045886 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f3c8c12d-c9b6-4d83-b012-066550ae1acc tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:18.046363 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f3c8c12d-c9b6-4d83-b012-066550ae1acc tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:18.046793 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f3c8c12d-c9b6-4d83-b012-066550ae1acc tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:18.047466 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f3c8c12d-c9b6-4d83-b012-066550ae1acc tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:18.047920 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f3c8c12d-c9b6-4d83-b012-066550ae1acc tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:18.048363 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f3c8c12d-c9b6-4d83-b012-066550ae1acc tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:18.176278 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-f3c8c12d-c9b6-4d83-b012-066550ae1acc tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:18.184785 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-f3c8c12d-c9b6-4d83-b012-066550ae1acc tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:18.186209 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-f3c8c12d-c9b6-4d83-b012-066550ae1acc tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:18.187336 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-f3c8c12d-c9b6-4d83-b012-066550ae1acc tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1731 microversion: 2.20 time: 0.152715 Sep 16 02:02:18.187883 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 392/772] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:02:18 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1731 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:02:18.613901 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-5f7b3d1b-e85d-4135-bcca-bb47bb1f3732 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:02:18.615267 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-5f7b3d1b-e85d-4135-bcca-bb47bb1f3732 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] [instance: 0171625e-3cb6-49d0-b5d6-d57409c02f47] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:02:18.621670 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-5f7b3d1b-e85d-4135-bcca-bb47bb1f3732 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:18.622159 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-5f7b3d1b-e85d-4135-bcca-bb47bb1f3732 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:18.622572 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-5f7b3d1b-e85d-4135-bcca-bb47bb1f3732 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:18.623246 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-5f7b3d1b-e85d-4135-bcca-bb47bb1f3732 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:18.623693 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-5f7b3d1b-e85d-4135-bcca-bb47bb1f3732 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:18.624146 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-5f7b3d1b-e85d-4135-bcca-bb47bb1f3732 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:18.755889 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-5f7b3d1b-e85d-4135-bcca-bb47bb1f3732 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14f57dd673f480c9984491a920fcacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b14dad85f52497c9819f0f3bb397f18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:18.763635 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-5f7b3d1b-e85d-4135-bcca-bb47bb1f3732 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] 10.222.0.42 "GET /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47" status: 200 len: 1319 microversion: 2.1 time: 0.153527 Sep 16 02:02:18.764221 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 381/773] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:02:18 2022] GET /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47 => generated 1319 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:02:19.214172 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-ae8baae6-7ea1-48f9-8b2b-6a60ee950b74 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:02:19.214729 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-ae8baae6-7ea1-48f9-8b2b-6a60ee950b74 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:02:19.221236 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ae8baae6-7ea1-48f9-8b2b-6a60ee950b74 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:19.221728 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ae8baae6-7ea1-48f9-8b2b-6a60ee950b74 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:19.222162 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ae8baae6-7ea1-48f9-8b2b-6a60ee950b74 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:19.222851 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ae8baae6-7ea1-48f9-8b2b-6a60ee950b74 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:19.223308 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ae8baae6-7ea1-48f9-8b2b-6a60ee950b74 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:19.223786 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ae8baae6-7ea1-48f9-8b2b-6a60ee950b74 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:19.356271 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-ae8baae6-7ea1-48f9-8b2b-6a60ee950b74 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:19.364190 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-ae8baae6-7ea1-48f9-8b2b-6a60ee950b74 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:19.365696 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-ae8baae6-7ea1-48f9-8b2b-6a60ee950b74 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:19.366846 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-ae8baae6-7ea1-48f9-8b2b-6a60ee950b74 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1731 microversion: 2.20 time: 0.156862 Sep 16 02:02:19.367410 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 393/774] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:02:19 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1731 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:02:19.787228 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-b02d7c7e-2c55-4f7f-b68a-3c5485b3e5c2 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:02:19.788892 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-b02d7c7e-2c55-4f7f-b68a-3c5485b3e5c2 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] [instance: 0171625e-3cb6-49d0-b5d6-d57409c02f47] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:02:19.795882 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b02d7c7e-2c55-4f7f-b68a-3c5485b3e5c2 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:19.796407 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b02d7c7e-2c55-4f7f-b68a-3c5485b3e5c2 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:19.796841 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b02d7c7e-2c55-4f7f-b68a-3c5485b3e5c2 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:19.797533 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b02d7c7e-2c55-4f7f-b68a-3c5485b3e5c2 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:19.797988 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b02d7c7e-2c55-4f7f-b68a-3c5485b3e5c2 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:19.798412 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b02d7c7e-2c55-4f7f-b68a-3c5485b3e5c2 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:19.941308 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-b02d7c7e-2c55-4f7f-b68a-3c5485b3e5c2 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14f57dd673f480c9984491a920fcacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b14dad85f52497c9819f0f3bb397f18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:19.949426 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-b02d7c7e-2c55-4f7f-b68a-3c5485b3e5c2 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] 10.222.0.42 "GET /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47" status: 200 len: 1319 microversion: 2.1 time: 0.166835 Sep 16 02:02:19.949996 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 382/775] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:02:19 2022] GET /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47 => generated 1319 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:02:20.393265 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-69dd2bd0-4a16-49a7-b674-4721fce6ae62 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:02:20.393906 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-69dd2bd0-4a16-49a7-b674-4721fce6ae62 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:02:20.400869 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-69dd2bd0-4a16-49a7-b674-4721fce6ae62 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:20.401350 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-69dd2bd0-4a16-49a7-b674-4721fce6ae62 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:20.401789 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-69dd2bd0-4a16-49a7-b674-4721fce6ae62 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:20.402471 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-69dd2bd0-4a16-49a7-b674-4721fce6ae62 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:20.402924 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-69dd2bd0-4a16-49a7-b674-4721fce6ae62 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:20.403349 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-69dd2bd0-4a16-49a7-b674-4721fce6ae62 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:20.537305 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-69dd2bd0-4a16-49a7-b674-4721fce6ae62 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:20.545490 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-69dd2bd0-4a16-49a7-b674-4721fce6ae62 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:20.546911 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-69dd2bd0-4a16-49a7-b674-4721fce6ae62 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:20.548084 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-69dd2bd0-4a16-49a7-b674-4721fce6ae62 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1718 microversion: 2.20 time: 0.158699 Sep 16 02:02:20.548649 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 394/776] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:02:20 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1718 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:02:20.972898 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-e81d43bc-2ab6-457f-bcf4-a7cc44e2de3e tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:02:20.973543 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-e81d43bc-2ab6-457f-bcf4-a7cc44e2de3e tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] [instance: 0171625e-3cb6-49d0-b5d6-d57409c02f47] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:02:20.976799 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_api:SELECT=60,nova_api:UPDATE=1 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:02:20.982172 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e81d43bc-2ab6-457f-bcf4-a7cc44e2de3e tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:20.982648 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e81d43bc-2ab6-457f-bcf4-a7cc44e2de3e tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:20.983076 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e81d43bc-2ab6-457f-bcf4-a7cc44e2de3e tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:20.983836 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e81d43bc-2ab6-457f-bcf4-a7cc44e2de3e tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:20.984315 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e81d43bc-2ab6-457f-bcf4-a7cc44e2de3e tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:20.984736 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e81d43bc-2ab6-457f-bcf4-a7cc44e2de3e tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:21.110516 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-e81d43bc-2ab6-457f-bcf4-a7cc44e2de3e tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14f57dd673f480c9984491a920fcacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b14dad85f52497c9819f0f3bb397f18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:21.119156 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-e81d43bc-2ab6-457f-bcf4-a7cc44e2de3e tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] 10.222.0.42 "GET /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47" status: 200 len: 1319 microversion: 2.1 time: 0.150046 Sep 16 02:02:21.119718 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 383/777] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:02:20 2022] GET /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47 => generated 1319 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 02:02:21.637325 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [req-4d452a41-3703-4f78-9e5a-1e728615b9e2 req-76996d17-5ac4-4e1f-96f2-35af529c0b1f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0171625e-3cb6-49d0-b5d6-d57409c02f47", "name": "network-vif-plugged", "status": "completed", "tag": "e2410910-0726-4839-b0cf-ae84d00a85c2"}]} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:02:21.642846 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_api:SELECT=63,nova_api:INSERT=3 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:02:21.650088 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-4d452a41-3703-4f78-9e5a-1e728615b9e2 req-76996d17-5ac4-4e1f-96f2-35af529c0b1f service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:21.650565 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-4d452a41-3703-4f78-9e5a-1e728615b9e2 req-76996d17-5ac4-4e1f-96f2-35af529c0b1f service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:21.650994 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-4d452a41-3703-4f78-9e5a-1e728615b9e2 req-76996d17-5ac4-4e1f-96f2-35af529c0b1f service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:21.664431 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.compute.server_external_events [req-4d452a41-3703-4f78-9e5a-1e728615b9e2 req-76996d17-5ac4-4e1f-96f2-35af529c0b1f service nova] Creating event network-vif-plugged:e2410910-0726-4839-b0cf-ae84d00a85c2 for instance 0171625e-3cb6-49d0-b5d6-d57409c02f47 on hv-cinder-84914 Sep 16 02:02:21.669473 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [req-4d452a41-3703-4f78-9e5a-1e728615b9e2 req-76996d17-5ac4-4e1f-96f2-35af529c0b1f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035974 Sep 16 02:02:21.670063 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 395/778] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:02:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:02:22.142415 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-a2900395-2407-428b-942e-8717cd097533 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:02:22.143040 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-a2900395-2407-428b-942e-8717cd097533 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] [instance: 0171625e-3cb6-49d0-b5d6-d57409c02f47] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:02:22.150503 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a2900395-2407-428b-942e-8717cd097533 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:22.150990 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a2900395-2407-428b-942e-8717cd097533 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:22.151438 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a2900395-2407-428b-942e-8717cd097533 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:22.152160 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a2900395-2407-428b-942e-8717cd097533 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:22.152614 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a2900395-2407-428b-942e-8717cd097533 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:22.153043 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a2900395-2407-428b-942e-8717cd097533 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:22.279281 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-a2900395-2407-428b-942e-8717cd097533 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14f57dd673f480c9984491a920fcacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b14dad85f52497c9819f0f3bb397f18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:22.286943 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-a2900395-2407-428b-942e-8717cd097533 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] 10.222.0.42 "GET /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47" status: 200 len: 1319 microversion: 2.1 time: 0.148435 Sep 16 02:02:22.287515 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 384/779] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:02:22 2022] GET /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47 => generated 1319 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:02:23.310894 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-176a8154-6118-4aa0-ad69-86ac334424ab tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:02:23.311586 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-176a8154-6118-4aa0-ad69-86ac334424ab tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] [instance: 0171625e-3cb6-49d0-b5d6-d57409c02f47] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:02:23.317609 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-176a8154-6118-4aa0-ad69-86ac334424ab tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:23.318084 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-176a8154-6118-4aa0-ad69-86ac334424ab tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:23.318512 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-176a8154-6118-4aa0-ad69-86ac334424ab tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:23.319482 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-176a8154-6118-4aa0-ad69-86ac334424ab tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:23.319974 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-176a8154-6118-4aa0-ad69-86ac334424ab tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:23.320402 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-176a8154-6118-4aa0-ad69-86ac334424ab tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:23.448904 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-176a8154-6118-4aa0-ad69-86ac334424ab tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14f57dd673f480c9984491a920fcacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b14dad85f52497c9819f0f3bb397f18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:23.456410 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-176a8154-6118-4aa0-ad69-86ac334424ab tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] 10.222.0.42 "GET /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47" status: 200 len: 1319 microversion: 2.1 time: 0.150232 Sep 16 02:02:23.456971 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 396/780] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:02:23 2022] GET /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47 => generated 1319 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:02:24.480507 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-e792edb2-296b-47e4-ab69-663c22559631 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:02:24.481120 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-e792edb2-296b-47e4-ab69-663c22559631 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] [instance: 0171625e-3cb6-49d0-b5d6-d57409c02f47] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:02:24.488537 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e792edb2-296b-47e4-ab69-663c22559631 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:24.489017 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e792edb2-296b-47e4-ab69-663c22559631 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:24.489449 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e792edb2-296b-47e4-ab69-663c22559631 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:24.490130 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e792edb2-296b-47e4-ab69-663c22559631 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:24.491180 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e792edb2-296b-47e4-ab69-663c22559631 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:24.491971 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e792edb2-296b-47e4-ab69-663c22559631 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:24.621676 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-e792edb2-296b-47e4-ab69-663c22559631 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14f57dd673f480c9984491a920fcacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b14dad85f52497c9819f0f3bb397f18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:24.629500 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-e792edb2-296b-47e4-ab69-663c22559631 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] 10.222.0.42 "GET /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47" status: 200 len: 1508 microversion: 2.1 time: 0.152965 Sep 16 02:02:24.630069 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 385/781] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:02:24 2022] GET /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47 => generated 1508 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:02:27.454751 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-fa481a60-2a4e-4c00-b219-1181cdc8f9ab tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:02:27.455272 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-fa481a60-2a4e-4c00-b219-1181cdc8f9ab tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: 069b7416-97ef-43ac-97f9-495b8eb0265f] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:02:27.462597 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fa481a60-2a4e-4c00-b219-1181cdc8f9ab tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:27.463087 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fa481a60-2a4e-4c00-b219-1181cdc8f9ab tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:27.463526 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fa481a60-2a4e-4c00-b219-1181cdc8f9ab tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:27.464260 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fa481a60-2a4e-4c00-b219-1181cdc8f9ab tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:27.464701 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fa481a60-2a4e-4c00-b219-1181cdc8f9ab tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:27.465136 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fa481a60-2a4e-4c00-b219-1181cdc8f9ab tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:27.489404 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-fa481a60-2a4e-4c00-b219-1181cdc8f9ab tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f/ips" status: 200 len: 145 microversion: 2.1 time: 0.038509 Sep 16 02:02:27.489991 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 397/782] 10.222.0.42 () {58 vars in 1248 bytes} [Fri Sep 16 02:02:27 2022] GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f/ips => generated 145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:02:28.831084 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-69f6f584-2e8a-498e-a9dc-ebe6b835813a tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6ad35cfb-99e8-43fa-96b9-8de7512bde69"}} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:02:28.833474 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-69f6f584-2e8a-498e-a9dc-ebe6b835813a tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: 069b7416-97ef-43ac-97f9-495b8eb0265f] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:02:28.840186 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-69f6f584-2e8a-498e-a9dc-ebe6b835813a tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:28.840666 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-69f6f584-2e8a-498e-a9dc-ebe6b835813a tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:28.841094 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-69f6f584-2e8a-498e-a9dc-ebe6b835813a tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:28.841771 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-69f6f584-2e8a-498e-a9dc-ebe6b835813a tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:28.842220 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-69f6f584-2e8a-498e-a9dc-ebe6b835813a tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:28.842638 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-69f6f584-2e8a-498e-a9dc-ebe6b835813a tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:29.110577 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-69f6f584-2e8a-498e-a9dc-ebe6b835813a tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "POST /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283279 Sep 16 02:02:29.111180 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 386/783] 10.222.0.42 () {60 vars in 1323 bytes} [Fri Sep 16 02:02:28 2022] POST /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:02:36.657624 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-1e0aeff1-5b76-4433-a843-32b422f16253 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:02:36.660309 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-1e0aeff1-5b76-4433-a843-32b422f16253 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: 069b7416-97ef-43ac-97f9-495b8eb0265f] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:02:36.666853 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1e0aeff1-5b76-4433-a843-32b422f16253 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:36.667805 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1e0aeff1-5b76-4433-a843-32b422f16253 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:36.668270 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1e0aeff1-5b76-4433-a843-32b422f16253 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:36.668955 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1e0aeff1-5b76-4433-a843-32b422f16253 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:36.669514 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1e0aeff1-5b76-4433-a843-32b422f16253 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:36.669937 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1e0aeff1-5b76-4433-a843-32b422f16253 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:36.699985 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-1e0aeff1-5b76-4433-a843-32b422f16253 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046234 Sep 16 02:02:36.700527 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 398/784] 10.222.0.42 () {58 vars in 1302 bytes} [Fri Sep 16 02:02:36 2022] GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 02:02:36.712369 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-c99f21d0-9c40-4a55-9a23-12f449c49efe tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:02:36.712945 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-c99f21d0-9c40-4a55-9a23-12f449c49efe tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: 069b7416-97ef-43ac-97f9-495b8eb0265f] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:02:36.719240 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c99f21d0-9c40-4a55-9a23-12f449c49efe tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:36.719721 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c99f21d0-9c40-4a55-9a23-12f449c49efe tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:36.720186 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c99f21d0-9c40-4a55-9a23-12f449c49efe tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:36.720871 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c99f21d0-9c40-4a55-9a23-12f449c49efe tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:36.721320 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c99f21d0-9c40-4a55-9a23-12f449c49efe tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:36.721742 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c99f21d0-9c40-4a55-9a23-12f449c49efe tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:36.735002 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:02:36.752926 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-c99f21d0-9c40-4a55-9a23-12f449c49efe tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f/os-volume_attachments/6ad35cfb-99e8-43fa-96b9-8de7512bde69" status: 200 len: 194 microversion: 2.1 time: 0.045559 Sep 16 02:02:36.753499 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 387/785] 10.222.0.42 () {58 vars in 1413 bytes} [Fri Sep 16 02:02:36 2022] GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f/os-volume_attachments/6ad35cfb-99e8-43fa-96b9-8de7512bde69 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:02:38.084457 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-b921a87a-36eb-4006-afbe-4fa7bf4cb0f8 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4f0fd652-9a2b-4468-a224-4686d85c7e8f"}} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:02:38.086748 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-b921a87a-36eb-4006-afbe-4fa7bf4cb0f8 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: 069b7416-97ef-43ac-97f9-495b8eb0265f] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:02:38.093215 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b921a87a-36eb-4006-afbe-4fa7bf4cb0f8 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:38.093698 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b921a87a-36eb-4006-afbe-4fa7bf4cb0f8 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:38.094137 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b921a87a-36eb-4006-afbe-4fa7bf4cb0f8 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:38.094819 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b921a87a-36eb-4006-afbe-4fa7bf4cb0f8 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:38.095272 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b921a87a-36eb-4006-afbe-4fa7bf4cb0f8 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:38.095698 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b921a87a-36eb-4006-afbe-4fa7bf4cb0f8 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:38.366908 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-b921a87a-36eb-4006-afbe-4fa7bf4cb0f8 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "POST /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.286148 Sep 16 02:02:38.367591 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 399/786] 10.222.0.42 () {60 vars in 1323 bytes} [Fri Sep 16 02:02:38 2022] POST /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:02:46.962193 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-9cb36166-d57d-434e-a7f9-93482df71bff tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:02:46.964528 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-9cb36166-d57d-434e-a7f9-93482df71bff tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: 069b7416-97ef-43ac-97f9-495b8eb0265f] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:02:46.967775 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_api:SELECT=9 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:02:46.972920 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9cb36166-d57d-434e-a7f9-93482df71bff tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:46.973407 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9cb36166-d57d-434e-a7f9-93482df71bff tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:46.973876 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9cb36166-d57d-434e-a7f9-93482df71bff tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:46.974565 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9cb36166-d57d-434e-a7f9-93482df71bff tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:46.975020 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9cb36166-d57d-434e-a7f9-93482df71bff tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:46.975444 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9cb36166-d57d-434e-a7f9-93482df71bff tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:47.005649 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-9cb36166-d57d-434e-a7f9-93482df71bff tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047422 Sep 16 02:02:47.006196 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 388/787] 10.222.0.42 () {58 vars in 1302 bytes} [Fri Sep 16 02:02:46 2022] GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:02:47.146097 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-bdd94aa2-2c90-4e34-b9ff-ecc7e912275b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:02:47.146681 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-bdd94aa2-2c90-4e34-b9ff-ecc7e912275b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: 069b7416-97ef-43ac-97f9-495b8eb0265f] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:02:47.153076 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-bdd94aa2-2c90-4e34-b9ff-ecc7e912275b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:47.153575 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-bdd94aa2-2c90-4e34-b9ff-ecc7e912275b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:47.154013 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-bdd94aa2-2c90-4e34-b9ff-ecc7e912275b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:47.154699 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-bdd94aa2-2c90-4e34-b9ff-ecc7e912275b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:47.155156 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-bdd94aa2-2c90-4e34-b9ff-ecc7e912275b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:47.155579 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-bdd94aa2-2c90-4e34-b9ff-ecc7e912275b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:47.160148 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:02:47.186766 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-bdd94aa2-2c90-4e34-b9ff-ecc7e912275b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f/os-volume_attachments/6ad35cfb-99e8-43fa-96b9-8de7512bde69" status: 200 len: 194 microversion: 2.1 time: 0.045525 Sep 16 02:02:47.187347 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 400/788] 10.222.0.42 () {58 vars in 1413 bytes} [Fri Sep 16 02:02:47 2022] GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f/os-volume_attachments/6ad35cfb-99e8-43fa-96b9-8de7512bde69 => generated 194 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:02:47.197747 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-12829e5b-294c-46da-a292-5ceed13b6c05 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:02:47.198246 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-12829e5b-294c-46da-a292-5ceed13b6c05 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: 069b7416-97ef-43ac-97f9-495b8eb0265f] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:02:47.204832 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-12829e5b-294c-46da-a292-5ceed13b6c05 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:47.205318 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-12829e5b-294c-46da-a292-5ceed13b6c05 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:47.205758 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-12829e5b-294c-46da-a292-5ceed13b6c05 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:47.206445 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-12829e5b-294c-46da-a292-5ceed13b6c05 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:47.206903 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-12829e5b-294c-46da-a292-5ceed13b6c05 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:47.207331 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-12829e5b-294c-46da-a292-5ceed13b6c05 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:47.288456 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.objects.instance [None req-12829e5b-294c-46da-a292-5ceed13b6c05 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lazy-loading 'services' on Instance uuid 069b7416-97ef-43ac-97f9-495b8eb0265f {{(pid=120440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 02:02:47.359510 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-12829e5b-294c-46da-a292-5ceed13b6c05 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "DELETE /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f/os-volume_attachments/6ad35cfb-99e8-43fa-96b9-8de7512bde69" status: 202 len: 0 microversion: 2.1 time: 0.165448 Sep 16 02:02:47.360400 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 389/789] 10.222.0.42 () {58 vars in 1416 bytes} [Fri Sep 16 02:02:47 2022] DELETE /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f/os-volume_attachments/6ad35cfb-99e8-43fa-96b9-8de7512bde69 => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 02:02:49.553763 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-83ddf007-362d-47c3-9f5e-f5edaed8136a tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:02:49.554279 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-83ddf007-362d-47c3-9f5e-f5edaed8136a tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: 069b7416-97ef-43ac-97f9-495b8eb0265f] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:02:49.561109 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-83ddf007-362d-47c3-9f5e-f5edaed8136a tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:49.561593 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-83ddf007-362d-47c3-9f5e-f5edaed8136a tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:49.562032 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-83ddf007-362d-47c3-9f5e-f5edaed8136a tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:49.562718 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-83ddf007-362d-47c3-9f5e-f5edaed8136a tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:49.563172 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-83ddf007-362d-47c3-9f5e-f5edaed8136a tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:49.563595 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-83ddf007-362d-47c3-9f5e-f5edaed8136a tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:49.592719 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-83ddf007-362d-47c3-9f5e-f5edaed8136a tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f/os-volume_attachments/4f0fd652-9a2b-4468-a224-4686d85c7e8f" status: 200 len: 194 microversion: 2.1 time: 0.042863 Sep 16 02:02:49.593298 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 401/790] 10.222.0.42 () {58 vars in 1413 bytes} [Fri Sep 16 02:02:49 2022] GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f/os-volume_attachments/4f0fd652-9a2b-4468-a224-4686d85c7e8f => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:02:49.604501 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-021e1c67-7a77-4cc9-b72b-faa72d554f4b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:02:49.605098 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-021e1c67-7a77-4cc9-b72b-faa72d554f4b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: 069b7416-97ef-43ac-97f9-495b8eb0265f] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:02:49.612163 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-021e1c67-7a77-4cc9-b72b-faa72d554f4b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:49.612641 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-021e1c67-7a77-4cc9-b72b-faa72d554f4b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:49.613073 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-021e1c67-7a77-4cc9-b72b-faa72d554f4b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:49.613836 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-021e1c67-7a77-4cc9-b72b-faa72d554f4b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:49.614396 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-021e1c67-7a77-4cc9-b72b-faa72d554f4b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:49.614867 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-021e1c67-7a77-4cc9-b72b-faa72d554f4b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:49.695854 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.objects.instance [None req-021e1c67-7a77-4cc9-b72b-faa72d554f4b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lazy-loading 'services' on Instance uuid 069b7416-97ef-43ac-97f9-495b8eb0265f {{(pid=120440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 02:02:49.766129 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-021e1c67-7a77-4cc9-b72b-faa72d554f4b tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "DELETE /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f/os-volume_attachments/4f0fd652-9a2b-4468-a224-4686d85c7e8f" status: 202 len: 0 microversion: 2.1 time: 0.165799 Sep 16 02:02:49.766679 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 390/791] 10.222.0.42 () {58 vars in 1416 bytes} [Fri Sep 16 02:02:49 2022] DELETE /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f/os-volume_attachments/4f0fd652-9a2b-4468-a224-4686d85c7e8f => generated 0 bytes in 167 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 02:02:50.364463 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-9117c341-fbbf-4b00-83e3-68ecd05add04 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "146d482d-681e-47fa-b990-1501d098fb26", "device": "/dev/sdb"}} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:02:50.367390 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-9117c341-fbbf-4b00-83e3-68ecd05add04 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] [instance: 0171625e-3cb6-49d0-b5d6-d57409c02f47] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:02:50.373852 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9117c341-fbbf-4b00-83e3-68ecd05add04 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:50.374331 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9117c341-fbbf-4b00-83e3-68ecd05add04 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:50.374771 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9117c341-fbbf-4b00-83e3-68ecd05add04 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:50.375544 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9117c341-fbbf-4b00-83e3-68ecd05add04 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:50.377363 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9117c341-fbbf-4b00-83e3-68ecd05add04 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:50.377878 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9117c341-fbbf-4b00-83e3-68ecd05add04 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:50.644385 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-9117c341-fbbf-4b00-83e3-68ecd05add04 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] 10.222.0.42 "POST /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.283780 Sep 16 02:02:50.645121 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 402/792] 10.222.0.42 () {60 vars in 1323 bytes} [Fri Sep 16 02:02:50 2022] POST /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47/os-volume_attachments => generated 194 bytes in 285 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:02:50.956526 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-ea61e90c-040b-49f9-afef-60dbe0fe6f11 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:02:50.958870 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-ea61e90c-040b-49f9-afef-60dbe0fe6f11 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: 069b7416-97ef-43ac-97f9-495b8eb0265f] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:02:50.964954 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ea61e90c-040b-49f9-afef-60dbe0fe6f11 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:50.965434 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ea61e90c-040b-49f9-afef-60dbe0fe6f11 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:50.965869 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ea61e90c-040b-49f9-afef-60dbe0fe6f11 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:50.966552 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ea61e90c-040b-49f9-afef-60dbe0fe6f11 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:50.967003 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ea61e90c-040b-49f9-afef-60dbe0fe6f11 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:50.967432 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ea61e90c-040b-49f9-afef-60dbe0fe6f11 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:50.995418 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-ea61e90c-040b-49f9-afef-60dbe0fe6f11 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043654 Sep 16 02:02:50.996539 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 391/793] 10.222.0.42 () {58 vars in 1302 bytes} [Fri Sep 16 02:02:50 2022] GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 02:02:51.119331 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-8060a085-1cb8-4a5a-855d-16d587cc2aba tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:02:51.122498 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-8060a085-1cb8-4a5a-855d-16d587cc2aba tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: 069b7416-97ef-43ac-97f9-495b8eb0265f] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:02:51.128780 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8060a085-1cb8-4a5a-855d-16d587cc2aba tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:51.129250 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8060a085-1cb8-4a5a-855d-16d587cc2aba tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:51.129678 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8060a085-1cb8-4a5a-855d-16d587cc2aba tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:51.130353 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8060a085-1cb8-4a5a-855d-16d587cc2aba tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:51.130796 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8060a085-1cb8-4a5a-855d-16d587cc2aba tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:51.131210 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8060a085-1cb8-4a5a-855d-16d587cc2aba tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:51.160628 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-8060a085-1cb8-4a5a-855d-16d587cc2aba tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045968 Sep 16 02:02:51.161184 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 403/794] 10.222.0.42 () {58 vars in 1302 bytes} [Fri Sep 16 02:02:51 2022] GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 02:02:51.225287 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-ae61216f-34be-42ae-95a4-d31bd6768c00 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:02:51.225902 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-ae61216f-34be-42ae-95a4-d31bd6768c00 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: 069b7416-97ef-43ac-97f9-495b8eb0265f] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:02:51.233552 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ae61216f-34be-42ae-95a4-d31bd6768c00 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:51.234434 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ae61216f-34be-42ae-95a4-d31bd6768c00 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:51.235146 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ae61216f-34be-42ae-95a4-d31bd6768c00 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:51.235910 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ae61216f-34be-42ae-95a4-d31bd6768c00 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:51.236452 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ae61216f-34be-42ae-95a4-d31bd6768c00 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:51.236880 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ae61216f-34be-42ae-95a4-d31bd6768c00 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:51.263972 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-ae61216f-34be-42ae-95a4-d31bd6768c00 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: 069b7416-97ef-43ac-97f9-495b8eb0265f] Going to try to terminate instance {{(pid=120440) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 02:02:51.338163 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-ae61216f-34be-42ae-95a4-d31bd6768c00 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "DELETE /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f" status: 204 len: 0 microversion: 2.1 time: 0.116478 Sep 16 02:02:51.338683 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 392/795] 10.222.0.42 () {58 vars in 1239 bytes} [Fri Sep 16 02:02:51 2022] DELETE /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 02:02:51.348215 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-d4efd22d-510c-4cd0-b2be-6c33dfc98446 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:02:51.348818 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-d4efd22d-510c-4cd0-b2be-6c33dfc98446 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: 069b7416-97ef-43ac-97f9-495b8eb0265f] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:02:51.355031 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d4efd22d-510c-4cd0-b2be-6c33dfc98446 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:51.356213 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d4efd22d-510c-4cd0-b2be-6c33dfc98446 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:51.356859 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d4efd22d-510c-4cd0-b2be-6c33dfc98446 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:51.357544 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d4efd22d-510c-4cd0-b2be-6c33dfc98446 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:51.357999 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d4efd22d-510c-4cd0-b2be-6c33dfc98446 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:51.358421 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d4efd22d-510c-4cd0-b2be-6c33dfc98446 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:51.490495 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-d4efd22d-510c-4cd0-b2be-6c33dfc98446 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:51.498132 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-d4efd22d-510c-4cd0-b2be-6c33dfc98446 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f" status: 200 len: 1674 microversion: 2.1 time: 0.154561 Sep 16 02:02:51.498692 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 404/796] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:02:51 2022] GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f => generated 1674 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 02:02:52.522341 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-8b0e4d2c-478e-4f07-a27b-d6a4ac8ac342 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:02:52.523075 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-8b0e4d2c-478e-4f07-a27b-d6a4ac8ac342 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: 069b7416-97ef-43ac-97f9-495b8eb0265f] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:02:52.529418 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8b0e4d2c-478e-4f07-a27b-d6a4ac8ac342 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:52.529895 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8b0e4d2c-478e-4f07-a27b-d6a4ac8ac342 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:52.530328 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8b0e4d2c-478e-4f07-a27b-d6a4ac8ac342 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:52.531009 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8b0e4d2c-478e-4f07-a27b-d6a4ac8ac342 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:52.531461 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8b0e4d2c-478e-4f07-a27b-d6a4ac8ac342 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:52.531884 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8b0e4d2c-478e-4f07-a27b-d6a4ac8ac342 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:52.665273 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-8b0e4d2c-478e-4f07-a27b-d6a4ac8ac342 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:52.673463 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-8b0e4d2c-478e-4f07-a27b-d6a4ac8ac342 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f" status: 200 len: 1674 microversion: 2.1 time: 0.155648 Sep 16 02:02:52.674025 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 393/797] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:02:52 2022] GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:02:53.697128 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-08c461d1-8946-4170-8e74-37950c48d0f7 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:02:53.697720 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-08c461d1-8946-4170-8e74-37950c48d0f7 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: 069b7416-97ef-43ac-97f9-495b8eb0265f] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:02:53.700598 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_api:SELECT=20 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:02:53.706011 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-08c461d1-8946-4170-8e74-37950c48d0f7 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:53.706488 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-08c461d1-8946-4170-8e74-37950c48d0f7 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:53.706917 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-08c461d1-8946-4170-8e74-37950c48d0f7 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:53.707588 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-08c461d1-8946-4170-8e74-37950c48d0f7 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:53.708065 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-08c461d1-8946-4170-8e74-37950c48d0f7 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:53.708486 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-08c461d1-8946-4170-8e74-37950c48d0f7 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:53.919170 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-08c461d1-8946-4170-8e74-37950c48d0f7 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:53.926817 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-08c461d1-8946-4170-8e74-37950c48d0f7 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f" status: 200 len: 1674 microversion: 2.1 time: 0.233488 Sep 16 02:02:53.927384 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 405/798] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:02:53 2022] GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f => generated 1674 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:02:54.610250 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [req-713fa3bc-2078-42b4-8d31-cd0c67a50844 req-e6e18b4b-6291-4d2b-8fc7-cc043899ea29 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "069b7416-97ef-43ac-97f9-495b8eb0265f", "name": "network-vif-deleted", "tag": "910a23a7-03f3-4a82-b8d8-4b238685b022"}]} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:02:54.622524 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-713fa3bc-2078-42b4-8d31-cd0c67a50844 req-e6e18b4b-6291-4d2b-8fc7-cc043899ea29 service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:54.623006 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-713fa3bc-2078-42b4-8d31-cd0c67a50844 req-e6e18b4b-6291-4d2b-8fc7-cc043899ea29 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:54.623428 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-713fa3bc-2078-42b4-8d31-cd0c67a50844 req-e6e18b4b-6291-4d2b-8fc7-cc043899ea29 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:54.636218 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.compute.server_external_events [req-713fa3bc-2078-42b4-8d31-cd0c67a50844 req-e6e18b4b-6291-4d2b-8fc7-cc043899ea29 service nova] Creating event network-vif-deleted:910a23a7-03f3-4a82-b8d8-4b238685b022 for instance 069b7416-97ef-43ac-97f9-495b8eb0265f on hv-cinder-84914 Sep 16 02:02:54.643618 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [req-713fa3bc-2078-42b4-8d31-cd0c67a50844 req-e6e18b4b-6291-4d2b-8fc7-cc043899ea29 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036700 Sep 16 02:02:54.644329 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 394/799] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:02:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:02:54.956210 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-2ee59e37-8dde-4c2b-b218-d3975eb47842 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:02:54.956210 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-2ee59e37-8dde-4c2b-b218-d3975eb47842 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: 069b7416-97ef-43ac-97f9-495b8eb0265f] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:02:54.957773 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2ee59e37-8dde-4c2b-b218-d3975eb47842 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:54.958264 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2ee59e37-8dde-4c2b-b218-d3975eb47842 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:54.958702 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2ee59e37-8dde-4c2b-b218-d3975eb47842 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:54.959392 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2ee59e37-8dde-4c2b-b218-d3975eb47842 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:54.960040 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2ee59e37-8dde-4c2b-b218-d3975eb47842 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:54.960625 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2ee59e37-8dde-4c2b-b218-d3975eb47842 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:54.991829 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2ee59e37-8dde-4c2b-b218-d3975eb47842 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:54.992352 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2ee59e37-8dde-4c2b-b218-d3975eb47842 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:54.992790 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2ee59e37-8dde-4c2b-b218-d3975eb47842 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:54.993234 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.objects.instance [None req-2ee59e37-8dde-4c2b-b218-d3975eb47842 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lazy-loading 'fault' on Instance uuid 069b7416-97ef-43ac-97f9-495b8eb0265f {{(pid=120441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 02:02:55.037683 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-2ee59e37-8dde-4c2b-b218-d3975eb47842 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6fc9485505c443acb946ec66e0018f7b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'eddbb633debb4badb74f142d92baed98', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:02:55.046209 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-2ee59e37-8dde-4c2b-b218-d3975eb47842 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f" status: 200 len: 1328 microversion: 2.1 time: 0.099636 Sep 16 02:02:55.046782 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 406/800] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:02:54 2022] GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f => generated 1328 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:02:56.069688 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-8f53d0b8-c4d5-4c49-a1ab-cfa45ed40b76 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:02:56.070304 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-8f53d0b8-c4d5-4c49-a1ab-cfa45ed40b76 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: 069b7416-97ef-43ac-97f9-495b8eb0265f] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:02:56.076823 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8f53d0b8-c4d5-4c49-a1ab-cfa45ed40b76 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:56.077299 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8f53d0b8-c4d5-4c49-a1ab-cfa45ed40b76 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:56.077733 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8f53d0b8-c4d5-4c49-a1ab-cfa45ed40b76 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:56.078415 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8f53d0b8-c4d5-4c49-a1ab-cfa45ed40b76 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:56.078875 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8f53d0b8-c4d5-4c49-a1ab-cfa45ed40b76 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:56.079300 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8f53d0b8-c4d5-4c49-a1ab-cfa45ed40b76 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:56.092930 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.wsgi [None req-8f53d0b8-c4d5-4c49-a1ab-cfa45ed40b76 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] HTTP exception thrown: Instance 069b7416-97ef-43ac-97f9-495b8eb0265f could not be found. Sep 16 02:02:56.094542 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-8f53d0b8-c4d5-4c49-a1ab-cfa45ed40b76 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Request method failure captured: Sep 16 02:02:56.094542 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: request: GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f HTTP/1.1 Sep 16 02:02:56.094542 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept: application/json Sep 16 02:02:56.094542 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept-Encoding: identity Sep 16 02:02:56.094542 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Connection: close Sep 16 02:02:56.094542 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Length: 0 Sep 16 02:02:56.094542 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Type: application/json Sep 16 02:02:56.094542 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Host: 10.222.0.42 Sep 16 02:02:56.094542 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Openstack-System-Scope: None Sep 16 02:02:56.094542 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: User-Agent: python-urllib3/1.26.12 Sep 16 02:02:56.094542 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Auth-Token: gAAAAABjI9c5m0JwV558PKGOeHNSUgxacR_33r1uAN-rfBRY-HMfoYiGQstlScCIjb6UGFB5kk4_TmIw8v_iJxaibF6dXSM_npfV-jnRA1BFwfavqM1Nh_4mHwaP3tGBAg4_o-KWd6IJRTlJIq8txMlwyESHhlcR7bqDqc8If40eCLsDY_P0oIA Sep 16 02:02:56.094542 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Id: None Sep 16 02:02:56.094542 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Name: None Sep 16 02:02:56.094542 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Identity-Status: Confirmed Sep 16 02:02:56.094542 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Is-Admin-Project: True Sep 16 02:02:56.094542 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Id: default Sep 16 02:02:56.094542 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Name: Default Sep 16 02:02:56.094542 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Id: eddbb633debb4badb74f142d92baed98 Sep 16 02:02:56.094542 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Name: tempest-AttachVolumeTestJSON-1166911222 Sep 16 02:02:56.094542 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Role: member,reader Sep 16 02:02:56.094542 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Roles: member,reader Sep 16 02:02:56.096158 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/eddbb633debb4badb74f142d92baed98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/eddbb633debb4badb74f142d92baed98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_eddbb633debb4badb74f142d92baed98"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/eddbb633debb4badb74f142d92baed98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 02:02:56.096158 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant: tempest-AttachVolumeTestJSON-1166911222 Sep 16 02:02:56.096158 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Id: eddbb633debb4badb74f142d92baed98 Sep 16 02:02:56.096158 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1166911222 Sep 16 02:02:56.096158 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User: tempest-AttachVolumeTestJSON-1166911222-project Sep 16 02:02:56.096158 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Id: default Sep 16 02:02:56.096158 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Name: Default Sep 16 02:02:56.096158 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Id: 6fc9485505c443acb946ec66e0018f7b Sep 16 02:02:56.096158 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Name: tempest-AttachVolumeTestJSON-1166911222-project Sep 16 02:02:56.096158 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: method: > Sep 16 02:02:56.096158 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: exception: Instance 069b7416-97ef-43ac-97f9-495b8eb0265f could not be found. Sep 16 02:02:56.096158 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: action_args: {'id': '069b7416-97ef-43ac-97f9-495b8eb0265f'} Sep 16 02:02:56.097075 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 02:02:56.097075 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:02:56.097075 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 02:02:56.097075 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 02:02:56.097075 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 02:02:56.097075 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 02:02:56.097075 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 02:02:56.097075 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 02:02:56.097075 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 02:02:56.097075 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 02:02:56.097075 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 069b7416-97ef-43ac-97f9-495b8eb0265f could not be found. Sep 16 02:02:56.097075 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:02:56.097075 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:02:56.097075 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:02:56.097075 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:02:56.097075 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:02:56.097075 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:02:56.097075 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 02:02:56.097075 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 02:02:56.097075 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 02:02:56.098587 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 02:02:56.098587 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 02:02:56.098587 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 02:02:56.098587 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 02:02:56.098587 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 02:02:56.098587 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 02:02:56.098587 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 02:02:56.098587 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 069b7416-97ef-43ac-97f9-495b8eb0265f could not be found. Sep 16 02:02:56.098587 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:02:56.098587 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:02:56.098587 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:02:56.098587 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:02:56.098587 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:02:56.098587 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:02:56.098587 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 02:02:56.098587 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 02:02:56.098587 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 069b7416-97ef-43ac-97f9-495b8eb0265f could not be found. Sep 16 02:02:56.098587 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:02:56.100007 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-8f53d0b8-c4d5-4c49-a1ab-cfa45ed40b76 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Returning 404 to user: Instance 069b7416-97ef-43ac-97f9-495b8eb0265f could not be found. {{(pid=120440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 02:02:56.100007 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-8f53d0b8-c4d5-4c49-a1ab-cfa45ed40b76 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f" status: 404 len: 111 microversion: 2.1 time: 0.030494 Sep 16 02:02:56.100007 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 395/801] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:02:56 2022] GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 02:02:56.104608 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-6ff2481c-3577-4f09-8442-a254268b39ed tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '.version_select at 0x7fae3627a280>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:02:56.123693 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-6ff2481c-3577-4f09-8442-a254268b39ed tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1631180497" status: 202 len: 0 microversion: 2.1 time: 0.022833 Sep 16 02:02:56.124303 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 407/802] 10.222.0.42 () {58 vars in 1221 bytes} [Fri Sep 16 02:02:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1631180497 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 02:02:59.015675 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-8f2986ea-092f-41c2-91e0-2dabd317ae44 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:02:59.016195 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-8f2986ea-092f-41c2-91e0-2dabd317ae44 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: 069b7416-97ef-43ac-97f9-495b8eb0265f] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:02:59.023065 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8f2986ea-092f-41c2-91e0-2dabd317ae44 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:59.023544 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8f2986ea-092f-41c2-91e0-2dabd317ae44 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:59.024009 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8f2986ea-092f-41c2-91e0-2dabd317ae44 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:59.024685 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8f2986ea-092f-41c2-91e0-2dabd317ae44 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:59.025133 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8f2986ea-092f-41c2-91e0-2dabd317ae44 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:59.025549 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8f2986ea-092f-41c2-91e0-2dabd317ae44 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:59.041438 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.wsgi [None req-8f2986ea-092f-41c2-91e0-2dabd317ae44 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] HTTP exception thrown: Instance 069b7416-97ef-43ac-97f9-495b8eb0265f could not be found. Sep 16 02:02:59.044020 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-8f2986ea-092f-41c2-91e0-2dabd317ae44 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Request method failure captured: Sep 16 02:02:59.044020 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: request: DELETE /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f HTTP/1.1 Sep 16 02:02:59.044020 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept: application/json Sep 16 02:02:59.044020 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept-Encoding: identity Sep 16 02:02:59.044020 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Connection: close Sep 16 02:02:59.044020 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Length: 0 Sep 16 02:02:59.044020 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Type: application/json Sep 16 02:02:59.044020 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Host: 10.222.0.42 Sep 16 02:02:59.044020 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Openstack-System-Scope: None Sep 16 02:02:59.044020 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: User-Agent: python-urllib3/1.26.12 Sep 16 02:02:59.044020 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Auth-Token: gAAAAABjI9c5m0JwV558PKGOeHNSUgxacR_33r1uAN-rfBRY-HMfoYiGQstlScCIjb6UGFB5kk4_TmIw8v_iJxaibF6dXSM_npfV-jnRA1BFwfavqM1Nh_4mHwaP3tGBAg4_o-KWd6IJRTlJIq8txMlwyESHhlcR7bqDqc8If40eCLsDY_P0oIA Sep 16 02:02:59.044020 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Id: None Sep 16 02:02:59.044020 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Name: None Sep 16 02:02:59.044020 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Identity-Status: Confirmed Sep 16 02:02:59.044020 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Is-Admin-Project: True Sep 16 02:02:59.044020 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Id: default Sep 16 02:02:59.044020 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Name: Default Sep 16 02:02:59.044020 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Id: eddbb633debb4badb74f142d92baed98 Sep 16 02:02:59.044020 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Name: tempest-AttachVolumeTestJSON-1166911222 Sep 16 02:02:59.044020 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Role: member,reader Sep 16 02:02:59.044020 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Roles: member,reader Sep 16 02:02:59.045567 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/eddbb633debb4badb74f142d92baed98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/eddbb633debb4badb74f142d92baed98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_eddbb633debb4badb74f142d92baed98"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/eddbb633debb4badb74f142d92baed98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 02:02:59.045567 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant: tempest-AttachVolumeTestJSON-1166911222 Sep 16 02:02:59.045567 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Id: eddbb633debb4badb74f142d92baed98 Sep 16 02:02:59.045567 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1166911222 Sep 16 02:02:59.045567 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User: tempest-AttachVolumeTestJSON-1166911222-project Sep 16 02:02:59.045567 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Id: default Sep 16 02:02:59.045567 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Name: Default Sep 16 02:02:59.045567 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Id: 6fc9485505c443acb946ec66e0018f7b Sep 16 02:02:59.045567 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Name: tempest-AttachVolumeTestJSON-1166911222-project Sep 16 02:02:59.045567 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: method: > Sep 16 02:02:59.045567 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: exception: Instance 069b7416-97ef-43ac-97f9-495b8eb0265f could not be found. Sep 16 02:02:59.045567 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: action_args: {'id': '069b7416-97ef-43ac-97f9-495b8eb0265f'} Sep 16 02:02:59.046374 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 02:02:59.046374 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:02:59.046374 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 02:02:59.046374 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 02:02:59.046374 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 02:02:59.046374 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 02:02:59.046374 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 02:02:59.046374 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 02:02:59.046374 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 02:02:59.046374 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 02:02:59.046374 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 069b7416-97ef-43ac-97f9-495b8eb0265f could not be found. Sep 16 02:02:59.046374 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:02:59.046374 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:02:59.046374 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:02:59.046374 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:02:59.046374 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:02:59.046374 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:02:59.046374 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 02:02:59.046374 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 02:02:59.046374 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 02:02:59.047526 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 02:02:59.047526 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 02:02:59.047526 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 02:02:59.047526 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 02:02:59.047526 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 02:02:59.047526 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 02:02:59.047526 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 02:02:59.047526 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 02:02:59.047526 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 02:02:59.047526 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 069b7416-97ef-43ac-97f9-495b8eb0265f could not be found. Sep 16 02:02:59.047526 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:02:59.047526 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:02:59.047526 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:02:59.047526 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:02:59.047526 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:02:59.047526 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:02:59.047526 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 02:02:59.047526 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 02:02:59.047526 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 069b7416-97ef-43ac-97f9-495b8eb0265f could not be found. Sep 16 02:02:59.047526 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:02:59.048884 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-8f2986ea-092f-41c2-91e0-2dabd317ae44 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Returning 404 to user: Instance 069b7416-97ef-43ac-97f9-495b8eb0265f could not be found. {{(pid=120440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 02:02:59.048884 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-8f2986ea-092f-41c2-91e0-2dabd317ae44 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "DELETE /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f" status: 404 len: 111 microversion: 2.1 time: 0.033639 Sep 16 02:02:59.048884 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 396/803] 10.222.0.42 () {58 vars in 1239 bytes} [Fri Sep 16 02:02:59 2022] DELETE /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 02:02:59.054554 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-e09ac8fc-e397-4e45-baee-27716bb79738 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:02:59.055204 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-e09ac8fc-e397-4e45-baee-27716bb79738 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: 069b7416-97ef-43ac-97f9-495b8eb0265f] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:02:59.061773 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e09ac8fc-e397-4e45-baee-27716bb79738 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:59.062198 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e09ac8fc-e397-4e45-baee-27716bb79738 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:59.062638 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e09ac8fc-e397-4e45-baee-27716bb79738 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:59.063329 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e09ac8fc-e397-4e45-baee-27716bb79738 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:02:59.063783 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e09ac8fc-e397-4e45-baee-27716bb79738 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:02:59.064238 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e09ac8fc-e397-4e45-baee-27716bb79738 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:02:59.077174 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.wsgi [None req-e09ac8fc-e397-4e45-baee-27716bb79738 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] HTTP exception thrown: Instance 069b7416-97ef-43ac-97f9-495b8eb0265f could not be found. Sep 16 02:02:59.078803 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-e09ac8fc-e397-4e45-baee-27716bb79738 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Request method failure captured: Sep 16 02:02:59.078803 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: request: GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f HTTP/1.1 Sep 16 02:02:59.078803 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Accept: application/json Sep 16 02:02:59.078803 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Accept-Encoding: identity Sep 16 02:02:59.078803 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Connection: close Sep 16 02:02:59.078803 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Content-Length: 0 Sep 16 02:02:59.078803 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Content-Type: application/json Sep 16 02:02:59.078803 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Host: 10.222.0.42 Sep 16 02:02:59.078803 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Openstack-System-Scope: None Sep 16 02:02:59.078803 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: User-Agent: python-urllib3/1.26.12 Sep 16 02:02:59.078803 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Auth-Token: gAAAAABjI9c5m0JwV558PKGOeHNSUgxacR_33r1uAN-rfBRY-HMfoYiGQstlScCIjb6UGFB5kk4_TmIw8v_iJxaibF6dXSM_npfV-jnRA1BFwfavqM1Nh_4mHwaP3tGBAg4_o-KWd6IJRTlJIq8txMlwyESHhlcR7bqDqc8If40eCLsDY_P0oIA Sep 16 02:02:59.078803 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Domain-Id: None Sep 16 02:02:59.078803 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Domain-Name: None Sep 16 02:02:59.078803 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Identity-Status: Confirmed Sep 16 02:02:59.078803 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Is-Admin-Project: True Sep 16 02:02:59.078803 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Domain-Id: default Sep 16 02:02:59.078803 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Domain-Name: Default Sep 16 02:02:59.078803 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Id: eddbb633debb4badb74f142d92baed98 Sep 16 02:02:59.078803 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Name: tempest-AttachVolumeTestJSON-1166911222 Sep 16 02:02:59.078803 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Role: member,reader Sep 16 02:02:59.078803 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Roles: member,reader Sep 16 02:02:59.080337 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/eddbb633debb4badb74f142d92baed98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/eddbb633debb4badb74f142d92baed98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_eddbb633debb4badb74f142d92baed98"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/eddbb633debb4badb74f142d92baed98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 02:02:59.080337 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant: tempest-AttachVolumeTestJSON-1166911222 Sep 16 02:02:59.080337 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant-Id: eddbb633debb4badb74f142d92baed98 Sep 16 02:02:59.080337 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1166911222 Sep 16 02:02:59.080337 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User: tempest-AttachVolumeTestJSON-1166911222-project Sep 16 02:02:59.080337 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Domain-Id: default Sep 16 02:02:59.080337 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Domain-Name: Default Sep 16 02:02:59.080337 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Id: 6fc9485505c443acb946ec66e0018f7b Sep 16 02:02:59.080337 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Name: tempest-AttachVolumeTestJSON-1166911222-project Sep 16 02:02:59.080337 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: method: > Sep 16 02:02:59.080337 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: exception: Instance 069b7416-97ef-43ac-97f9-495b8eb0265f could not be found. Sep 16 02:02:59.080337 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: action_args: {'id': '069b7416-97ef-43ac-97f9-495b8eb0265f'} Sep 16 02:02:59.081213 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 02:02:59.081213 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:02:59.081213 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 02:02:59.081213 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 02:02:59.081213 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 02:02:59.081213 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 02:02:59.081213 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 02:02:59.081213 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 02:02:59.081213 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 02:02:59.081213 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 02:02:59.081213 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 069b7416-97ef-43ac-97f9-495b8eb0265f could not be found. Sep 16 02:02:59.081213 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:02:59.081213 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:02:59.081213 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:02:59.081213 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:02:59.081213 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:02:59.081213 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:02:59.081213 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 02:02:59.081213 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 02:02:59.081213 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 02:02:59.082636 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 02:02:59.082636 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 02:02:59.082636 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 02:02:59.082636 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 02:02:59.082636 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 02:02:59.082636 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 02:02:59.082636 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 02:02:59.082636 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 069b7416-97ef-43ac-97f9-495b8eb0265f could not be found. Sep 16 02:02:59.082636 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:02:59.082636 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:02:59.082636 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:02:59.082636 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:02:59.082636 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:02:59.082636 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:02:59.082636 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 02:02:59.082636 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 02:02:59.082636 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 069b7416-97ef-43ac-97f9-495b8eb0265f could not be found. Sep 16 02:02:59.082636 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:02:59.083854 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-e09ac8fc-e397-4e45-baee-27716bb79738 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Returning 404 to user: Instance 069b7416-97ef-43ac-97f9-495b8eb0265f could not be found. {{(pid=120441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 02:02:59.083854 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-e09ac8fc-e397-4e45-baee-27716bb79738 tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f" status: 404 len: 111 microversion: 2.1 time: 0.030155 Sep 16 02:02:59.083854 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 408/804] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:02:59 2022] GET /compute/v2.1/servers/069b7416-97ef-43ac-97f9-495b8eb0265f => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 02:03:03.380406 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-294ba8be-4173-4f6e-ae00-9ec6dc4defea tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:03:03.380908 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-294ba8be-4173-4f6e-ae00-9ec6dc4defea tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:03:03.387081 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-294ba8be-4173-4f6e-ae00-9ec6dc4defea tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:03:03.387557 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-294ba8be-4173-4f6e-ae00-9ec6dc4defea tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:03:03.388024 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-294ba8be-4173-4f6e-ae00-9ec6dc4defea tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:03:03.388710 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-294ba8be-4173-4f6e-ae00-9ec6dc4defea tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:03:03.389159 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-294ba8be-4173-4f6e-ae00-9ec6dc4defea tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:03:03.389578 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-294ba8be-4173-4f6e-ae00-9ec6dc4defea tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:03:03.402939 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.wsgi [None req-294ba8be-4173-4f6e-ae00-9ec6dc4defea tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] HTTP exception thrown: Instance df8bdee8-15d2-4b18-a2d0-8b24b43f6763 could not be found. Sep 16 02:03:03.404487 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-294ba8be-4173-4f6e-ae00-9ec6dc4defea tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Request method failure captured: Sep 16 02:03:03.404487 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: request: DELETE /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 HTTP/1.1 Sep 16 02:03:03.404487 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept: application/json Sep 16 02:03:03.404487 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept-Encoding: identity Sep 16 02:03:03.404487 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Connection: close Sep 16 02:03:03.404487 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Length: 0 Sep 16 02:03:03.404487 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Type: application/json Sep 16 02:03:03.404487 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Host: 10.222.0.42 Sep 16 02:03:03.404487 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Openstack-System-Scope: None Sep 16 02:03:03.404487 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: User-Agent: python-urllib3/1.26.12 Sep 16 02:03:03.404487 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Auth-Token: gAAAAABjI9c5m0JwV558PKGOeHNSUgxacR_33r1uAN-rfBRY-HMfoYiGQstlScCIjb6UGFB5kk4_TmIw8v_iJxaibF6dXSM_npfV-jnRA1BFwfavqM1Nh_4mHwaP3tGBAg4_o-KWd6IJRTlJIq8txMlwyESHhlcR7bqDqc8If40eCLsDY_P0oIA Sep 16 02:03:03.404487 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Id: None Sep 16 02:03:03.404487 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Name: None Sep 16 02:03:03.404487 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Identity-Status: Confirmed Sep 16 02:03:03.404487 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Is-Admin-Project: True Sep 16 02:03:03.404487 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Id: default Sep 16 02:03:03.404487 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Name: Default Sep 16 02:03:03.404487 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Id: eddbb633debb4badb74f142d92baed98 Sep 16 02:03:03.404487 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Name: tempest-AttachVolumeTestJSON-1166911222 Sep 16 02:03:03.404487 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Role: member,reader Sep 16 02:03:03.404487 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Roles: member,reader Sep 16 02:03:03.406057 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/eddbb633debb4badb74f142d92baed98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/eddbb633debb4badb74f142d92baed98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_eddbb633debb4badb74f142d92baed98"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/eddbb633debb4badb74f142d92baed98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 02:03:03.406057 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant: tempest-AttachVolumeTestJSON-1166911222 Sep 16 02:03:03.406057 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Id: eddbb633debb4badb74f142d92baed98 Sep 16 02:03:03.406057 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1166911222 Sep 16 02:03:03.406057 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User: tempest-AttachVolumeTestJSON-1166911222-project Sep 16 02:03:03.406057 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Id: default Sep 16 02:03:03.406057 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Name: Default Sep 16 02:03:03.406057 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Id: 6fc9485505c443acb946ec66e0018f7b Sep 16 02:03:03.406057 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Name: tempest-AttachVolumeTestJSON-1166911222-project Sep 16 02:03:03.406057 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: method: > Sep 16 02:03:03.406057 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: exception: Instance df8bdee8-15d2-4b18-a2d0-8b24b43f6763 could not be found. Sep 16 02:03:03.406057 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: action_args: {'id': 'df8bdee8-15d2-4b18-a2d0-8b24b43f6763'} Sep 16 02:03:03.406837 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 02:03:03.406837 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:03:03.406837 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 02:03:03.406837 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 02:03:03.406837 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 02:03:03.406837 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 02:03:03.406837 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 02:03:03.406837 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 02:03:03.406837 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 02:03:03.406837 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 02:03:03.406837 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df8bdee8-15d2-4b18-a2d0-8b24b43f6763 could not be found. Sep 16 02:03:03.406837 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:03:03.406837 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:03:03.406837 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:03:03.406837 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:03:03.406837 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:03:03.406837 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:03:03.406837 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 02:03:03.406837 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 02:03:03.406837 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 02:03:03.408067 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 02:03:03.408067 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 02:03:03.408067 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 02:03:03.408067 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 02:03:03.408067 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 02:03:03.408067 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 02:03:03.408067 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 02:03:03.408067 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 02:03:03.408067 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 02:03:03.408067 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df8bdee8-15d2-4b18-a2d0-8b24b43f6763 could not be found. Sep 16 02:03:03.408067 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:03:03.408067 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:03:03.408067 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:03:03.408067 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:03:03.408067 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:03:03.408067 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:03:03.408067 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 02:03:03.408067 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 02:03:03.408067 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df8bdee8-15d2-4b18-a2d0-8b24b43f6763 could not be found. Sep 16 02:03:03.408067 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:03:03.409545 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-294ba8be-4173-4f6e-ae00-9ec6dc4defea tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Returning 404 to user: Instance df8bdee8-15d2-4b18-a2d0-8b24b43f6763 could not be found. {{(pid=120440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 02:03:03.409545 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-294ba8be-4173-4f6e-ae00-9ec6dc4defea tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "DELETE /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 404 len: 111 microversion: 2.1 time: 0.029307 Sep 16 02:03:03.409545 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 397/805] 10.222.0.42 () {58 vars in 1239 bytes} [Fri Sep 16 02:03:03 2022] DELETE /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 02:03:03.414285 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-2eaee370-f561-4c9f-9901-4c7735020c8e tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:03:03.414927 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-2eaee370-f561-4c9f-9901-4c7735020c8e tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] [instance: df8bdee8-15d2-4b18-a2d0-8b24b43f6763] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:03:03.422341 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2eaee370-f561-4c9f-9901-4c7735020c8e tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:03:03.422822 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2eaee370-f561-4c9f-9901-4c7735020c8e tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:03:03.423256 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2eaee370-f561-4c9f-9901-4c7735020c8e tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:03:03.423953 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2eaee370-f561-4c9f-9901-4c7735020c8e tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:03:03.424408 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2eaee370-f561-4c9f-9901-4c7735020c8e tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:03:03.424829 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2eaee370-f561-4c9f-9901-4c7735020c8e tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:03:03.438404 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.wsgi [None req-2eaee370-f561-4c9f-9901-4c7735020c8e tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] HTTP exception thrown: Instance df8bdee8-15d2-4b18-a2d0-8b24b43f6763 could not be found. Sep 16 02:03:03.439901 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-2eaee370-f561-4c9f-9901-4c7735020c8e tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Request method failure captured: Sep 16 02:03:03.439901 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: request: GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 HTTP/1.1 Sep 16 02:03:03.439901 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Accept: application/json Sep 16 02:03:03.439901 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Accept-Encoding: identity Sep 16 02:03:03.439901 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Connection: close Sep 16 02:03:03.439901 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Content-Length: 0 Sep 16 02:03:03.439901 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Content-Type: application/json Sep 16 02:03:03.439901 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Host: 10.222.0.42 Sep 16 02:03:03.439901 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Openstack-System-Scope: None Sep 16 02:03:03.439901 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: User-Agent: python-urllib3/1.26.12 Sep 16 02:03:03.439901 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Auth-Token: gAAAAABjI9c5m0JwV558PKGOeHNSUgxacR_33r1uAN-rfBRY-HMfoYiGQstlScCIjb6UGFB5kk4_TmIw8v_iJxaibF6dXSM_npfV-jnRA1BFwfavqM1Nh_4mHwaP3tGBAg4_o-KWd6IJRTlJIq8txMlwyESHhlcR7bqDqc8If40eCLsDY_P0oIA Sep 16 02:03:03.439901 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Domain-Id: None Sep 16 02:03:03.439901 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Domain-Name: None Sep 16 02:03:03.439901 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Identity-Status: Confirmed Sep 16 02:03:03.439901 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Is-Admin-Project: True Sep 16 02:03:03.439901 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Domain-Id: default Sep 16 02:03:03.439901 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Domain-Name: Default Sep 16 02:03:03.439901 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Id: eddbb633debb4badb74f142d92baed98 Sep 16 02:03:03.439901 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Name: tempest-AttachVolumeTestJSON-1166911222 Sep 16 02:03:03.439901 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Role: member,reader Sep 16 02:03:03.439901 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Roles: member,reader Sep 16 02:03:03.441457 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/eddbb633debb4badb74f142d92baed98"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/eddbb633debb4badb74f142d92baed98"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_eddbb633debb4badb74f142d92baed98"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/eddbb633debb4badb74f142d92baed98"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 02:03:03.441457 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant: tempest-AttachVolumeTestJSON-1166911222 Sep 16 02:03:03.441457 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant-Id: eddbb633debb4badb74f142d92baed98 Sep 16 02:03:03.441457 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1166911222 Sep 16 02:03:03.441457 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User: tempest-AttachVolumeTestJSON-1166911222-project Sep 16 02:03:03.441457 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Domain-Id: default Sep 16 02:03:03.441457 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Domain-Name: Default Sep 16 02:03:03.441457 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Id: 6fc9485505c443acb946ec66e0018f7b Sep 16 02:03:03.441457 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Name: tempest-AttachVolumeTestJSON-1166911222-project Sep 16 02:03:03.441457 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: method: > Sep 16 02:03:03.441457 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: exception: Instance df8bdee8-15d2-4b18-a2d0-8b24b43f6763 could not be found. Sep 16 02:03:03.441457 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: action_args: {'id': 'df8bdee8-15d2-4b18-a2d0-8b24b43f6763'} Sep 16 02:03:03.442341 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 02:03:03.442341 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:03:03.442341 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 02:03:03.442341 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 02:03:03.442341 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 02:03:03.442341 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 02:03:03.442341 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 02:03:03.442341 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 02:03:03.442341 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 02:03:03.442341 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 02:03:03.442341 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance df8bdee8-15d2-4b18-a2d0-8b24b43f6763 could not be found. Sep 16 02:03:03.442341 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:03:03.442341 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:03:03.442341 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:03:03.442341 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:03:03.442341 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:03:03.442341 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:03:03.442341 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 02:03:03.442341 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 02:03:03.442341 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 02:03:03.443764 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 02:03:03.443764 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 02:03:03.443764 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 02:03:03.443764 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 02:03:03.443764 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 02:03:03.443764 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 02:03:03.443764 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 02:03:03.443764 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance df8bdee8-15d2-4b18-a2d0-8b24b43f6763 could not be found. Sep 16 02:03:03.443764 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:03:03.443764 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:03:03.443764 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:03:03.443764 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:03:03.443764 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:03:03.443764 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:03:03.443764 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 02:03:03.443764 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 02:03:03.443764 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance df8bdee8-15d2-4b18-a2d0-8b24b43f6763 could not be found. Sep 16 02:03:03.443764 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:03:03.445250 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-2eaee370-f561-4c9f-9901-4c7735020c8e tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] Returning 404 to user: Instance df8bdee8-15d2-4b18-a2d0-8b24b43f6763 could not be found. {{(pid=120441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 02:03:03.445250 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-2eaee370-f561-4c9f-9901-4c7735020c8e tempest-AttachVolumeTestJSON-1166911222 tempest-AttachVolumeTestJSON-1166911222-project] 10.222.0.42 "GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763" status: 404 len: 111 microversion: 2.1 time: 0.030852 Sep 16 02:03:03.445250 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 409/806] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:03:03 2022] GET /compute/v2.1/servers/df8bdee8-15d2-4b18-a2d0-8b24b43f6763 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 02:03:17.533353 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-8234ff08-ece8-4ebf-bbe7-5b339ef4dc1d tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:03:17.533353 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-8234ff08-ece8-4ebf-bbe7-5b339ef4dc1d tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] [instance: 0171625e-3cb6-49d0-b5d6-d57409c02f47] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:03:17.535255 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_api:SELECT=25,nova_api:UPDATE=1 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:03:17.536022 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell1:SELECT=61,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:03:17.542789 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8234ff08-ece8-4ebf-bbe7-5b339ef4dc1d tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:03:17.543271 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8234ff08-ece8-4ebf-bbe7-5b339ef4dc1d tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:03:17.543710 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8234ff08-ece8-4ebf-bbe7-5b339ef4dc1d tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:03:17.544431 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8234ff08-ece8-4ebf-bbe7-5b339ef4dc1d tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:03:17.544889 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8234ff08-ece8-4ebf-bbe7-5b339ef4dc1d tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:03:17.545316 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8234ff08-ece8-4ebf-bbe7-5b339ef4dc1d tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:03:17.636932 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.objects.instance [None req-8234ff08-ece8-4ebf-bbe7-5b339ef4dc1d tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lazy-loading 'services' on Instance uuid 0171625e-3cb6-49d0-b5d6-d57409c02f47 {{(pid=120440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 02:03:17.709782 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-8234ff08-ece8-4ebf-bbe7-5b339ef4dc1d tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47/os-volume_attachments/146d482d-681e-47fa-b990-1501d098fb26" status: 202 len: 0 microversion: 2.1 time: 0.181421 Sep 16 02:03:17.710367 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 398/807] 10.222.0.42 () {58 vars in 1416 bytes} [Fri Sep 16 02:03:17 2022] DELETE /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47/os-volume_attachments/146d482d-681e-47fa-b990-1501d098fb26 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 02:03:18.846124 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-d7f9e6dd-83dd-47f8-bd61-9dc7ad60fb08 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:03:18.846624 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-d7f9e6dd-83dd-47f8-bd61-9dc7ad60fb08 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] [instance: 0171625e-3cb6-49d0-b5d6-d57409c02f47] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:03:18.849074 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_api:SELECT=12,nova_api:DELETE=1 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:03:18.849747 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell1:SELECT=52,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:03:18.855444 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d7f9e6dd-83dd-47f8-bd61-9dc7ad60fb08 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:03:18.855929 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d7f9e6dd-83dd-47f8-bd61-9dc7ad60fb08 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:03:18.856390 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d7f9e6dd-83dd-47f8-bd61-9dc7ad60fb08 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:03:18.857080 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d7f9e6dd-83dd-47f8-bd61-9dc7ad60fb08 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:03:18.857534 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d7f9e6dd-83dd-47f8-bd61-9dc7ad60fb08 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:03:18.857958 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d7f9e6dd-83dd-47f8-bd61-9dc7ad60fb08 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:03:18.886482 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-d7f9e6dd-83dd-47f8-bd61-9dc7ad60fb08 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] [instance: 0171625e-3cb6-49d0-b5d6-d57409c02f47] Going to try to terminate instance {{(pid=120441) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 02:03:18.965646 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-d7f9e6dd-83dd-47f8-bd61-9dc7ad60fb08 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] 10.222.0.42 "DELETE /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47" status: 204 len: 0 microversion: 2.1 time: 0.123053 Sep 16 02:03:18.966266 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 410/808] 10.222.0.42 () {58 vars in 1239 bytes} [Fri Sep 16 02:03:18 2022] DELETE /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47 => generated 0 bytes in 125 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 02:03:18.975615 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-c3ac1084-da40-429a-bcc6-b61bc8cdd534 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:03:18.976322 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-c3ac1084-da40-429a-bcc6-b61bc8cdd534 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] [instance: 0171625e-3cb6-49d0-b5d6-d57409c02f47] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:03:18.982847 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c3ac1084-da40-429a-bcc6-b61bc8cdd534 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:03:18.983324 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c3ac1084-da40-429a-bcc6-b61bc8cdd534 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:03:18.983754 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c3ac1084-da40-429a-bcc6-b61bc8cdd534 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:03:18.984462 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c3ac1084-da40-429a-bcc6-b61bc8cdd534 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:03:18.984915 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c3ac1084-da40-429a-bcc6-b61bc8cdd534 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:03:18.985337 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c3ac1084-da40-429a-bcc6-b61bc8cdd534 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:03:19.119842 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-c3ac1084-da40-429a-bcc6-b61bc8cdd534 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14f57dd673f480c9984491a920fcacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b14dad85f52497c9819f0f3bb397f18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:03:19.127922 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-c3ac1084-da40-429a-bcc6-b61bc8cdd534 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] 10.222.0.42 "GET /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47" status: 200 len: 1514 microversion: 2.1 time: 0.156974 Sep 16 02:03:19.128498 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 399/809] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:03:18 2022] GET /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47 => generated 1514 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:03:20.153182 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-75ab2480-bce1-43bd-abd5-76618f6d3d01 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:03:20.153796 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-75ab2480-bce1-43bd-abd5-76618f6d3d01 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] [instance: 0171625e-3cb6-49d0-b5d6-d57409c02f47] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:03:20.160095 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-75ab2480-bce1-43bd-abd5-76618f6d3d01 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:03:20.160573 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-75ab2480-bce1-43bd-abd5-76618f6d3d01 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:03:20.161003 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-75ab2480-bce1-43bd-abd5-76618f6d3d01 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:03:20.161682 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-75ab2480-bce1-43bd-abd5-76618f6d3d01 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:03:20.162126 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-75ab2480-bce1-43bd-abd5-76618f6d3d01 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:03:20.162546 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-75ab2480-bce1-43bd-abd5-76618f6d3d01 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:03:20.295086 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-75ab2480-bce1-43bd-abd5-76618f6d3d01 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14f57dd673f480c9984491a920fcacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b14dad85f52497c9819f0f3bb397f18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:03:20.302607 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-75ab2480-bce1-43bd-abd5-76618f6d3d01 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] 10.222.0.42 "GET /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47" status: 200 len: 1514 microversion: 2.1 time: 0.154619 Sep 16 02:03:20.303125 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 411/810] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:03:20 2022] GET /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47 => generated 1514 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:03:21.326352 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-eeba1907-ff75-44c3-a3b5-bd0fa551b6ac tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:03:21.326944 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-eeba1907-ff75-44c3-a3b5-bd0fa551b6ac tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] [instance: 0171625e-3cb6-49d0-b5d6-d57409c02f47] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:03:21.334509 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-eeba1907-ff75-44c3-a3b5-bd0fa551b6ac tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:03:21.335227 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-eeba1907-ff75-44c3-a3b5-bd0fa551b6ac tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:03:21.335674 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-eeba1907-ff75-44c3-a3b5-bd0fa551b6ac tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:03:21.336616 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-eeba1907-ff75-44c3-a3b5-bd0fa551b6ac tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:03:21.337082 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-eeba1907-ff75-44c3-a3b5-bd0fa551b6ac tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:03:21.337522 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-eeba1907-ff75-44c3-a3b5-bd0fa551b6ac tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:03:21.483850 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-eeba1907-ff75-44c3-a3b5-bd0fa551b6ac tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14f57dd673f480c9984491a920fcacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b14dad85f52497c9819f0f3bb397f18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:03:21.492550 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-eeba1907-ff75-44c3-a3b5-bd0fa551b6ac tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] 10.222.0.42 "GET /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47" status: 200 len: 1514 microversion: 2.1 time: 0.170630 Sep 16 02:03:21.493132 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 400/811] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:03:21 2022] GET /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47 => generated 1514 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 02:03:21.515087 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [req-cce52f7e-78f8-45b8-9db6-2d8128a7f0b9 req-27bd500f-430c-46e2-bb68-3e889386369d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "0171625e-3cb6-49d0-b5d6-d57409c02f47", "name": "network-vif-deleted", "tag": "e2410910-0726-4839-b0cf-ae84d00a85c2"}]} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:03:21.530099 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-cce52f7e-78f8-45b8-9db6-2d8128a7f0b9 req-27bd500f-430c-46e2-bb68-3e889386369d service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:03:21.530603 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-cce52f7e-78f8-45b8-9db6-2d8128a7f0b9 req-27bd500f-430c-46e2-bb68-3e889386369d service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:03:21.531032 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-cce52f7e-78f8-45b8-9db6-2d8128a7f0b9 req-27bd500f-430c-46e2-bb68-3e889386369d service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:03:21.543799 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.compute.server_external_events [req-cce52f7e-78f8-45b8-9db6-2d8128a7f0b9 req-27bd500f-430c-46e2-bb68-3e889386369d service nova] Creating event network-vif-deleted:e2410910-0726-4839-b0cf-ae84d00a85c2 for instance 0171625e-3cb6-49d0-b5d6-d57409c02f47 on hv-cinder-84914 Sep 16 02:03:21.548983 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [req-cce52f7e-78f8-45b8-9db6-2d8128a7f0b9 req-27bd500f-430c-46e2-bb68-3e889386369d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038213 Sep 16 02:03:21.549543 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 412/812] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:03:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:03:22.517761 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-284fb465-51df-4e55-9e3b-790245223be4 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:03:22.518286 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-284fb465-51df-4e55-9e3b-790245223be4 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] [instance: 0171625e-3cb6-49d0-b5d6-d57409c02f47] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:03:22.524702 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-284fb465-51df-4e55-9e3b-790245223be4 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:03:22.525183 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-284fb465-51df-4e55-9e3b-790245223be4 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:03:22.525613 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-284fb465-51df-4e55-9e3b-790245223be4 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:03:22.526320 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-284fb465-51df-4e55-9e3b-790245223be4 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:03:22.526868 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-284fb465-51df-4e55-9e3b-790245223be4 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:03:22.527293 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-284fb465-51df-4e55-9e3b-790245223be4 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:03:22.540313 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.wsgi [None req-284fb465-51df-4e55-9e3b-790245223be4 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] HTTP exception thrown: Instance 0171625e-3cb6-49d0-b5d6-d57409c02f47 could not be found. Sep 16 02:03:22.542157 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-284fb465-51df-4e55-9e3b-790245223be4 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Request method failure captured: Sep 16 02:03:22.542157 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: request: GET /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47 HTTP/1.1 Sep 16 02:03:22.542157 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept: application/json Sep 16 02:03:22.542157 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept-Encoding: identity Sep 16 02:03:22.542157 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Connection: close Sep 16 02:03:22.542157 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Length: 0 Sep 16 02:03:22.542157 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Type: application/json Sep 16 02:03:22.542157 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Host: 10.222.0.42 Sep 16 02:03:22.542157 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Openstack-System-Scope: None Sep 16 02:03:22.542157 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: User-Agent: python-urllib3/1.26.12 Sep 16 02:03:22.542157 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Auth-Token: gAAAAABjI9kUSzjDL7dT03Up0jFI__rPLs-SGN9gnWdyx5zL_FcmxTR2j3wa5oZ6fntbpwfWLCR155lUAlZSkuXtdvC6eYk0pjVGCVGer3BCX018vrcqK4w3JeY8heVQhNRbuQufmxTfI3NRfDnU3IxX1Zsy96CC8A4eHO9XiPh_51JEPkVAvSA Sep 16 02:03:22.542157 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Id: None Sep 16 02:03:22.542157 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Name: None Sep 16 02:03:22.542157 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Identity-Status: Confirmed Sep 16 02:03:22.542157 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Is-Admin-Project: True Sep 16 02:03:22.542157 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Id: default Sep 16 02:03:22.542157 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Name: Default Sep 16 02:03:22.542157 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Id: 0b14dad85f52497c9819f0f3bb397f18 Sep 16 02:03:22.542157 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Name: tempest-VolumesSnapshotTestJSON-525688138 Sep 16 02:03:22.542157 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Role: member,reader Sep 16 02:03:22.542157 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Roles: member,reader Sep 16 02:03:22.543769 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/0b14dad85f52497c9819f0f3bb397f18"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0b14dad85f52497c9819f0f3bb397f18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_0b14dad85f52497c9819f0f3bb397f18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0b14dad85f52497c9819f0f3bb397f18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 02:03:22.543769 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant: tempest-VolumesSnapshotTestJSON-525688138 Sep 16 02:03:22.543769 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Id: 0b14dad85f52497c9819f0f3bb397f18 Sep 16 02:03:22.543769 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-525688138 Sep 16 02:03:22.543769 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User: tempest-VolumesSnapshotTestJSON-525688138-project Sep 16 02:03:22.543769 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Id: default Sep 16 02:03:22.543769 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Name: Default Sep 16 02:03:22.543769 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Id: a14f57dd673f480c9984491a920fcacd Sep 16 02:03:22.543769 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Name: tempest-VolumesSnapshotTestJSON-525688138-project Sep 16 02:03:22.543769 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: method: > Sep 16 02:03:22.543769 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: exception: Instance 0171625e-3cb6-49d0-b5d6-d57409c02f47 could not be found. Sep 16 02:03:22.543769 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: action_args: {'id': '0171625e-3cb6-49d0-b5d6-d57409c02f47'} Sep 16 02:03:22.546885 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 02:03:22.546885 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:03:22.546885 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 02:03:22.546885 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 02:03:22.546885 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 02:03:22.546885 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 02:03:22.546885 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 02:03:22.546885 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 02:03:22.546885 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 02:03:22.546885 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 02:03:22.546885 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 0171625e-3cb6-49d0-b5d6-d57409c02f47 could not be found. Sep 16 02:03:22.546885 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:03:22.546885 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:03:22.546885 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:03:22.546885 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:03:22.546885 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:03:22.546885 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:03:22.546885 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 02:03:22.546885 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 02:03:22.546885 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 02:03:22.548426 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 02:03:22.548426 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 02:03:22.548426 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 02:03:22.548426 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 02:03:22.548426 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 02:03:22.548426 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 02:03:22.548426 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 02:03:22.548426 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 0171625e-3cb6-49d0-b5d6-d57409c02f47 could not be found. Sep 16 02:03:22.548426 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:03:22.548426 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:03:22.548426 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:03:22.548426 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:03:22.548426 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:03:22.548426 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:03:22.548426 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 02:03:22.548426 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 02:03:22.548426 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 0171625e-3cb6-49d0-b5d6-d57409c02f47 could not be found. Sep 16 02:03:22.548426 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:03:22.549770 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-284fb465-51df-4e55-9e3b-790245223be4 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Returning 404 to user: Instance 0171625e-3cb6-49d0-b5d6-d57409c02f47 could not be found. {{(pid=120440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 02:03:22.549770 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-284fb465-51df-4e55-9e3b-790245223be4 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] 10.222.0.42 "GET /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47" status: 404 len: 111 microversion: 2.1 time: 0.029799 Sep 16 02:03:22.549770 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 401/813] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:03:22 2022] GET /compute/v2.1/servers/0171625e-3cb6-49d0-b5d6-d57409c02f47 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 02:03:39.661093 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_api:SELECT=11,nova_api:UPDATE=1 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:03:39.661693 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell1:SELECT=22,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:03:39.665831 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-c0b7b57c-3fb7-4de7-b4c9-f036502a59c5 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-109991326", "imageRef": "1546da04-912c-44c6-b4b9-34fba35e08f6", "flavorRef": "452", "networks": [{"uuid": "29a4b870-3f83-4eb0-9540-67d659221c2c"}]}} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:03:39.720831 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.network.neutron [None req-c0b7b57c-3fb7-4de7-b4c9-f036502a59c5 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] validate_networks() for [('29a4b870-3f83-4eb0-9540-67d659221c2c', None, None, None, None, None)] {{(pid=120441) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 02:03:40.062609 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.virt.hardware [None req-c0b7b57c-3fb7-4de7-b4c9-f036502a59c5 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Flavor limits 0:0:0 {{(pid=120441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 02:03:40.062974 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.virt.hardware [None req-c0b7b57c-3fb7-4de7-b4c9-f036502a59c5 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Image limits 0:0:0 {{(pid=120441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 02:03:40.063443 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.virt.hardware [None req-c0b7b57c-3fb7-4de7-b4c9-f036502a59c5 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Flavor pref 0:0:0 {{(pid=120441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 02:03:40.063909 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.virt.hardware [None req-c0b7b57c-3fb7-4de7-b4c9-f036502a59c5 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Image pref 0:0:0 {{(pid=120441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 02:03:40.064348 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.virt.hardware [None req-c0b7b57c-3fb7-4de7-b4c9-f036502a59c5 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 02:03:40.072982 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c0b7b57c-3fb7-4de7-b4c9-f036502a59c5 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:03:40.073456 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c0b7b57c-3fb7-4de7-b4c9-f036502a59c5 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:03:40.073887 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c0b7b57c-3fb7-4de7-b4c9-f036502a59c5 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:03:40.074602 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c0b7b57c-3fb7-4de7-b4c9-f036502a59c5 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:03:40.075050 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c0b7b57c-3fb7-4de7-b4c9-f036502a59c5 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:03:40.075471 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c0b7b57c-3fb7-4de7-b4c9-f036502a59c5 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:03:40.092946 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.quota [None req-c0b7b57c-3fb7-4de7-b4c9-f036502a59c5 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Getting quotas for project 0b14dad85f52497c9819f0f3bb397f18. Resources: {'cores', 'ram', 'instances'} {{(pid=120441) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 02:03:40.096960 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.quota [None req-c0b7b57c-3fb7-4de7-b4c9-f036502a59c5 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Getting quotas for user a14f57dd673f480c9984491a920fcacd and project 0b14dad85f52497c9819f0f3bb397f18. Resources: {'cores', 'ram', 'instances'} {{(pid=120441) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 02:03:40.107752 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-c0b7b57c-3fb7-4de7-b4c9-f036502a59c5 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Going to run 1 instances... {{(pid=120441) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 02:03:40.110134 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-c0b7b57c-3fb7-4de7-b4c9-f036502a59c5 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] [instance: 6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1546da04-912c-44c6-b4b9-34fba35e08f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120441) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 02:03:40.155453 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-c0b7b57c-3fb7-4de7-b4c9-f036502a59c5 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.495966 Sep 16 02:03:40.156165 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 413/814] 10.222.0.42 () {60 vars in 1147 bytes} [Fri Sep 16 02:03:39 2022] POST /compute/v2.1/servers => generated 380 bytes in 497 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 16 02:03:40.167105 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-36ef2055-c4b5-476e-8aaa-f545497706b4 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:03:40.167720 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-36ef2055-c4b5-476e-8aaa-f545497706b4 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] [instance: 6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:03:40.170197 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_api:SELECT=8 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:03:40.175680 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell1:SELECT=23,nova_cell1:INSERT=1 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:03:40.228613 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-36ef2055-c4b5-476e-8aaa-f545497706b4 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14f57dd673f480c9984491a920fcacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b14dad85f52497c9819f0f3bb397f18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:03:40.236500 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-36ef2055-c4b5-476e-8aaa-f545497706b4 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] 10.222.0.42 "GET /compute/v2.1/servers/6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17" status: 200 len: 1218 microversion: 2.1 time: 0.073146 Sep 16 02:03:40.237068 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 402/815] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:03:40 2022] GET /compute/v2.1/servers/6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17 => generated 1218 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:03:41.260517 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-22faaa13-7825-4a7e-a938-df01ce34662c tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:03:41.261132 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-22faaa13-7825-4a7e-a938-df01ce34662c tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] [instance: 6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:03:41.268051 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-22faaa13-7825-4a7e-a938-df01ce34662c tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:03:41.268780 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-22faaa13-7825-4a7e-a938-df01ce34662c tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:03:41.269220 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-22faaa13-7825-4a7e-a938-df01ce34662c tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:03:41.269917 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-22faaa13-7825-4a7e-a938-df01ce34662c tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:03:41.270372 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-22faaa13-7825-4a7e-a938-df01ce34662c tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:03:41.270798 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-22faaa13-7825-4a7e-a938-df01ce34662c tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:03:41.371551 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-22faaa13-7825-4a7e-a938-df01ce34662c tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14f57dd673f480c9984491a920fcacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b14dad85f52497c9819f0f3bb397f18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:03:41.381269 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-22faaa13-7825-4a7e-a938-df01ce34662c tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] 10.222.0.42 "GET /compute/v2.1/servers/6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17" status: 200 len: 1278 microversion: 2.1 time: 0.125140 Sep 16 02:03:41.381849 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 414/816] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:03:41 2022] GET /compute/v2.1/servers/6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17 => generated 1278 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:03:42.405465 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-1b712de9-00bc-41fe-8b0f-13e0db1c2304 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:03:42.406025 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-1b712de9-00bc-41fe-8b0f-13e0db1c2304 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] [instance: 6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:03:42.413266 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1b712de9-00bc-41fe-8b0f-13e0db1c2304 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:03:42.413753 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1b712de9-00bc-41fe-8b0f-13e0db1c2304 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:03:42.414192 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1b712de9-00bc-41fe-8b0f-13e0db1c2304 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:03:42.414883 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1b712de9-00bc-41fe-8b0f-13e0db1c2304 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:03:42.415338 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1b712de9-00bc-41fe-8b0f-13e0db1c2304 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:03:42.415761 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1b712de9-00bc-41fe-8b0f-13e0db1c2304 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:03:42.548949 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-1b712de9-00bc-41fe-8b0f-13e0db1c2304 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14f57dd673f480c9984491a920fcacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b14dad85f52497c9819f0f3bb397f18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:03:42.556677 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-1b712de9-00bc-41fe-8b0f-13e0db1c2304 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] 10.222.0.42 "GET /compute/v2.1/servers/6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17" status: 200 len: 1318 microversion: 2.1 time: 0.155889 Sep 16 02:03:42.557243 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 403/817] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:03:42 2022] GET /compute/v2.1/servers/6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17 => generated 1318 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:03:42.755449 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [req-a18add91-9866-4edd-82d2-2c618e2340de req-3972269c-3ba7-414f-9ca3-38e245b83a43 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17", "tag": "eaea4902-1bf6-48bb-9a86-81bc1df71766"}]} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:03:42.766215 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-a18add91-9866-4edd-82d2-2c618e2340de req-3972269c-3ba7-414f-9ca3-38e245b83a43 service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:03:42.766731 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-a18add91-9866-4edd-82d2-2c618e2340de req-3972269c-3ba7-414f-9ca3-38e245b83a43 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:03:42.767535 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-a18add91-9866-4edd-82d2-2c618e2340de req-3972269c-3ba7-414f-9ca3-38e245b83a43 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:03:42.778875 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.compute.server_external_events [req-a18add91-9866-4edd-82d2-2c618e2340de req-3972269c-3ba7-414f-9ca3-38e245b83a43 service nova] Creating event network-changed:eaea4902-1bf6-48bb-9a86-81bc1df71766 for instance 6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17 on hv-cinder-84914 Sep 16 02:03:42.784194 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [req-a18add91-9866-4edd-82d2-2c618e2340de req-3972269c-3ba7-414f-9ca3-38e245b83a43 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032518 Sep 16 02:03:42.785665 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 415/818] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:03:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:03:43.584200 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-04e502ed-6545-4937-80fd-5f19d21d0610 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:03:43.584816 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-04e502ed-6545-4937-80fd-5f19d21d0610 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] [instance: 6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:03:43.591113 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-04e502ed-6545-4937-80fd-5f19d21d0610 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:03:43.591694 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-04e502ed-6545-4937-80fd-5f19d21d0610 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:03:43.592167 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-04e502ed-6545-4937-80fd-5f19d21d0610 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:03:43.592863 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-04e502ed-6545-4937-80fd-5f19d21d0610 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:03:43.593313 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-04e502ed-6545-4937-80fd-5f19d21d0610 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:03:43.593738 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-04e502ed-6545-4937-80fd-5f19d21d0610 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:03:43.723236 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-04e502ed-6545-4937-80fd-5f19d21d0610 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14f57dd673f480c9984491a920fcacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b14dad85f52497c9819f0f3bb397f18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:03:43.730769 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-04e502ed-6545-4937-80fd-5f19d21d0610 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] 10.222.0.42 "GET /compute/v2.1/servers/6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17" status: 200 len: 1318 microversion: 2.1 time: 0.150460 Sep 16 02:03:43.731326 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 404/819] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:03:43 2022] GET /compute/v2.1/servers/6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:03:44.755428 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-ee8ad137-9c25-4ec1-8cab-4f030d1dd7c3 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:03:44.756164 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-ee8ad137-9c25-4ec1-8cab-4f030d1dd7c3 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] [instance: 6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:03:44.762155 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ee8ad137-9c25-4ec1-8cab-4f030d1dd7c3 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:03:44.762630 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ee8ad137-9c25-4ec1-8cab-4f030d1dd7c3 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:03:44.763057 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ee8ad137-9c25-4ec1-8cab-4f030d1dd7c3 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:03:44.763726 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ee8ad137-9c25-4ec1-8cab-4f030d1dd7c3 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:03:44.764201 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ee8ad137-9c25-4ec1-8cab-4f030d1dd7c3 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:03:44.765204 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ee8ad137-9c25-4ec1-8cab-4f030d1dd7c3 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:03:44.894990 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-ee8ad137-9c25-4ec1-8cab-4f030d1dd7c3 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14f57dd673f480c9984491a920fcacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b14dad85f52497c9819f0f3bb397f18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:03:44.902467 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-ee8ad137-9c25-4ec1-8cab-4f030d1dd7c3 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] 10.222.0.42 "GET /compute/v2.1/servers/6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17" status: 200 len: 1318 microversion: 2.1 time: 0.151973 Sep 16 02:03:44.903036 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 416/820] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:03:44 2022] GET /compute/v2.1/servers/6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:03:45.925207 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-a9304c51-d6d9-4f03-900e-de061b260ee0 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:03:45.925852 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-a9304c51-d6d9-4f03-900e-de061b260ee0 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] [instance: 6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:03:45.932212 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a9304c51-d6d9-4f03-900e-de061b260ee0 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:03:45.932682 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a9304c51-d6d9-4f03-900e-de061b260ee0 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:03:45.933125 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a9304c51-d6d9-4f03-900e-de061b260ee0 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:03:45.933823 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a9304c51-d6d9-4f03-900e-de061b260ee0 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:03:45.934281 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a9304c51-d6d9-4f03-900e-de061b260ee0 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:03:45.934705 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a9304c51-d6d9-4f03-900e-de061b260ee0 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:03:46.072907 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-a9304c51-d6d9-4f03-900e-de061b260ee0 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14f57dd673f480c9984491a920fcacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b14dad85f52497c9819f0f3bb397f18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:03:46.081238 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-a9304c51-d6d9-4f03-900e-de061b260ee0 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] 10.222.0.42 "GET /compute/v2.1/servers/6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17" status: 200 len: 1318 microversion: 2.1 time: 0.159967 Sep 16 02:03:46.081813 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 405/821] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:03:45 2022] GET /compute/v2.1/servers/6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17 => generated 1318 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:03:47.104338 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-605e70dc-931e-4350-8d5f-317f83c31112 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:03:47.104950 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-605e70dc-931e-4350-8d5f-317f83c31112 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] [instance: 6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:03:47.111466 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-605e70dc-931e-4350-8d5f-317f83c31112 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:03:47.111965 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-605e70dc-931e-4350-8d5f-317f83c31112 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:03:47.112402 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-605e70dc-931e-4350-8d5f-317f83c31112 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:03:47.113070 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-605e70dc-931e-4350-8d5f-317f83c31112 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:03:47.113514 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-605e70dc-931e-4350-8d5f-317f83c31112 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:03:47.113929 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-605e70dc-931e-4350-8d5f-317f83c31112 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:03:47.243279 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-605e70dc-931e-4350-8d5f-317f83c31112 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14f57dd673f480c9984491a920fcacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b14dad85f52497c9819f0f3bb397f18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:03:47.251498 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-605e70dc-931e-4350-8d5f-317f83c31112 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] 10.222.0.42 "GET /compute/v2.1/servers/6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17" status: 200 len: 1318 microversion: 2.1 time: 0.150979 Sep 16 02:03:47.252077 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 417/822] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:03:47 2022] GET /compute/v2.1/servers/6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17 => generated 1318 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:03:48.275783 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-59e2fcaf-b8dc-47e7-8681-1b479b77384f tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:03:48.276901 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-59e2fcaf-b8dc-47e7-8681-1b479b77384f tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] [instance: 6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:03:48.286518 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-59e2fcaf-b8dc-47e7-8681-1b479b77384f tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:03:48.286999 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-59e2fcaf-b8dc-47e7-8681-1b479b77384f tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:03:48.287506 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-59e2fcaf-b8dc-47e7-8681-1b479b77384f tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:03:48.288232 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-59e2fcaf-b8dc-47e7-8681-1b479b77384f tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:03:48.288683 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-59e2fcaf-b8dc-47e7-8681-1b479b77384f tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:03:48.289104 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-59e2fcaf-b8dc-47e7-8681-1b479b77384f tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:03:48.418938 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-59e2fcaf-b8dc-47e7-8681-1b479b77384f tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14f57dd673f480c9984491a920fcacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b14dad85f52497c9819f0f3bb397f18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:03:48.427783 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-59e2fcaf-b8dc-47e7-8681-1b479b77384f tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] 10.222.0.42 "GET /compute/v2.1/servers/6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17" status: 200 len: 1318 microversion: 2.1 time: 0.156959 Sep 16 02:03:48.428400 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 406/823] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:03:48 2022] GET /compute/v2.1/servers/6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:03:49.452173 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-b4695a42-69b9-4c7d-a456-62844227b889 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:03:49.452783 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-b4695a42-69b9-4c7d-a456-62844227b889 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] [instance: 6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:03:49.459334 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b4695a42-69b9-4c7d-a456-62844227b889 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:03:49.459815 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b4695a42-69b9-4c7d-a456-62844227b889 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:03:49.460294 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b4695a42-69b9-4c7d-a456-62844227b889 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:03:49.460980 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b4695a42-69b9-4c7d-a456-62844227b889 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:03:49.461432 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b4695a42-69b9-4c7d-a456-62844227b889 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:03:49.461856 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b4695a42-69b9-4c7d-a456-62844227b889 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:03:49.595785 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-b4695a42-69b9-4c7d-a456-62844227b889 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14f57dd673f480c9984491a920fcacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b14dad85f52497c9819f0f3bb397f18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:03:49.603193 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-b4695a42-69b9-4c7d-a456-62844227b889 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] 10.222.0.42 "GET /compute/v2.1/servers/6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17" status: 200 len: 1318 microversion: 2.1 time: 0.154900 Sep 16 02:03:49.603751 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 418/824] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:03:49 2022] GET /compute/v2.1/servers/6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17 => generated 1318 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:03:50.627231 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-9999da3a-0387-4102-a379-1586f4e6c6ba tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:03:50.627852 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-9999da3a-0387-4102-a379-1586f4e6c6ba tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] [instance: 6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:03:50.630200 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell0:SELECT=2 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:03:50.635689 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9999da3a-0387-4102-a379-1586f4e6c6ba tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:03:50.636236 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9999da3a-0387-4102-a379-1586f4e6c6ba tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:03:50.636677 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9999da3a-0387-4102-a379-1586f4e6c6ba tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:03:50.637358 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9999da3a-0387-4102-a379-1586f4e6c6ba tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:03:50.637815 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9999da3a-0387-4102-a379-1586f4e6c6ba tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:03:50.638238 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9999da3a-0387-4102-a379-1586f4e6c6ba tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:03:50.767582 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-9999da3a-0387-4102-a379-1586f4e6c6ba tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14f57dd673f480c9984491a920fcacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b14dad85f52497c9819f0f3bb397f18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:03:50.775254 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-9999da3a-0387-4102-a379-1586f4e6c6ba tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] 10.222.0.42 "GET /compute/v2.1/servers/6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17" status: 200 len: 1318 microversion: 2.1 time: 0.152999 Sep 16 02:03:50.775827 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 407/825] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:03:50 2022] GET /compute/v2.1/servers/6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:03:51.799031 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-204dbf97-9926-4b4c-9c6b-1fd6e16784d0 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:03:51.799669 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-204dbf97-9926-4b4c-9c6b-1fd6e16784d0 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] [instance: 6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:03:51.801875 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell0:SELECT=2 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:03:51.803689 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell0:SELECT=6 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:03:51.810520 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-204dbf97-9926-4b4c-9c6b-1fd6e16784d0 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:03:51.812155 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-204dbf97-9926-4b4c-9c6b-1fd6e16784d0 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:03:51.812155 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-204dbf97-9926-4b4c-9c6b-1fd6e16784d0 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:03:51.812827 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-204dbf97-9926-4b4c-9c6b-1fd6e16784d0 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:03:51.813288 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-204dbf97-9926-4b4c-9c6b-1fd6e16784d0 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:03:51.813726 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-204dbf97-9926-4b4c-9c6b-1fd6e16784d0 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:03:52.216430 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-204dbf97-9926-4b4c-9c6b-1fd6e16784d0 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14f57dd673f480c9984491a920fcacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b14dad85f52497c9819f0f3bb397f18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:03:52.224959 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-204dbf97-9926-4b4c-9c6b-1fd6e16784d0 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] 10.222.0.42 "GET /compute/v2.1/servers/6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17" status: 200 len: 1318 microversion: 2.1 time: 0.430286 Sep 16 02:03:52.225553 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 419/826] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:03:51 2022] GET /compute/v2.1/servers/6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17 => generated 1318 bytes in 431 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:03:53.248432 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-1ff661f8-dc5c-44db-94b0-8495125a9333 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:03:53.249133 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-1ff661f8-dc5c-44db-94b0-8495125a9333 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] [instance: 6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:03:53.255758 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1ff661f8-dc5c-44db-94b0-8495125a9333 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:03:53.256280 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1ff661f8-dc5c-44db-94b0-8495125a9333 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:03:53.256716 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1ff661f8-dc5c-44db-94b0-8495125a9333 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:03:53.257403 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1ff661f8-dc5c-44db-94b0-8495125a9333 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:03:53.257858 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1ff661f8-dc5c-44db-94b0-8495125a9333 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:03:53.258284 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1ff661f8-dc5c-44db-94b0-8495125a9333 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:03:53.388877 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-1ff661f8-dc5c-44db-94b0-8495125a9333 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14f57dd673f480c9984491a920fcacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b14dad85f52497c9819f0f3bb397f18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:03:53.397715 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-1ff661f8-dc5c-44db-94b0-8495125a9333 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] 10.222.0.42 "GET /compute/v2.1/servers/6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17" status: 200 len: 1318 microversion: 2.1 time: 0.153180 Sep 16 02:03:53.398356 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 408/827] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:03:53 2022] GET /compute/v2.1/servers/6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17 => generated 1318 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:03:54.356429 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [req-9ff43e42-ee0c-4675-8891-8eff85819884 req-b49f41d7-51a9-487a-8df1-26e230fa6381 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17", "name": "network-vif-plugged", "status": "completed", "tag": "eaea4902-1bf6-48bb-9a86-81bc1df71766"}]} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:03:54.367777 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-9ff43e42-ee0c-4675-8891-8eff85819884 req-b49f41d7-51a9-487a-8df1-26e230fa6381 service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:03:54.368300 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-9ff43e42-ee0c-4675-8891-8eff85819884 req-b49f41d7-51a9-487a-8df1-26e230fa6381 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:03:54.368719 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-9ff43e42-ee0c-4675-8891-8eff85819884 req-b49f41d7-51a9-487a-8df1-26e230fa6381 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:03:54.381368 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.compute.server_external_events [req-9ff43e42-ee0c-4675-8891-8eff85819884 req-b49f41d7-51a9-487a-8df1-26e230fa6381 service nova] Creating event network-vif-plugged:eaea4902-1bf6-48bb-9a86-81bc1df71766 for instance 6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17 on hv-cinder-84914 Sep 16 02:03:54.386727 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [req-9ff43e42-ee0c-4675-8891-8eff85819884 req-b49f41d7-51a9-487a-8df1-26e230fa6381 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034084 Sep 16 02:03:54.387256 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 420/828] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:03:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:03:54.422057 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-22f1eb4b-3c0c-4ed4-8665-f96769d5a1e8 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:03:54.422769 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-22f1eb4b-3c0c-4ed4-8665-f96769d5a1e8 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] [instance: 6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:03:54.429172 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-22f1eb4b-3c0c-4ed4-8665-f96769d5a1e8 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:03:54.429657 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-22f1eb4b-3c0c-4ed4-8665-f96769d5a1e8 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:03:54.430112 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-22f1eb4b-3c0c-4ed4-8665-f96769d5a1e8 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:03:54.430821 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-22f1eb4b-3c0c-4ed4-8665-f96769d5a1e8 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:03:54.431275 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-22f1eb4b-3c0c-4ed4-8665-f96769d5a1e8 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:03:54.431698 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-22f1eb4b-3c0c-4ed4-8665-f96769d5a1e8 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:03:54.567402 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-22f1eb4b-3c0c-4ed4-8665-f96769d5a1e8 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14f57dd673f480c9984491a920fcacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b14dad85f52497c9819f0f3bb397f18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:03:54.575618 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-22f1eb4b-3c0c-4ed4-8665-f96769d5a1e8 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] 10.222.0.42 "GET /compute/v2.1/servers/6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17" status: 200 len: 1318 microversion: 2.1 time: 0.158148 Sep 16 02:03:54.576224 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 409/829] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:03:54 2022] GET /compute/v2.1/servers/6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17 => generated 1318 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:03:55.600592 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-517a63c1-b75c-447a-ab56-5daf272099eb tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:03:55.601316 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-517a63c1-b75c-447a-ab56-5daf272099eb tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] [instance: 6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:03:55.607784 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-517a63c1-b75c-447a-ab56-5daf272099eb tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:03:55.608299 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-517a63c1-b75c-447a-ab56-5daf272099eb tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:03:55.608730 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-517a63c1-b75c-447a-ab56-5daf272099eb tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:03:55.609724 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-517a63c1-b75c-447a-ab56-5daf272099eb tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:03:55.610231 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-517a63c1-b75c-447a-ab56-5daf272099eb tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:03:55.610650 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-517a63c1-b75c-447a-ab56-5daf272099eb tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:03:55.740388 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-517a63c1-b75c-447a-ab56-5daf272099eb tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14f57dd673f480c9984491a920fcacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b14dad85f52497c9819f0f3bb397f18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:03:55.747835 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-517a63c1-b75c-447a-ab56-5daf272099eb tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] 10.222.0.42 "GET /compute/v2.1/servers/6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17" status: 200 len: 1318 microversion: 2.1 time: 0.152429 Sep 16 02:03:55.748429 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 421/830] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:03:55 2022] GET /compute/v2.1/servers/6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17 => generated 1318 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:03:56.771958 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-301d3237-fb45-456b-8f26-1a4b71905a27 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:03:56.772700 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-301d3237-fb45-456b-8f26-1a4b71905a27 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] [instance: 6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:03:56.781007 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-301d3237-fb45-456b-8f26-1a4b71905a27 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:03:56.782155 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-301d3237-fb45-456b-8f26-1a4b71905a27 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:03:56.782667 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-301d3237-fb45-456b-8f26-1a4b71905a27 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:03:56.783525 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-301d3237-fb45-456b-8f26-1a4b71905a27 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:03:56.784096 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-301d3237-fb45-456b-8f26-1a4b71905a27 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:03:56.785033 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-301d3237-fb45-456b-8f26-1a4b71905a27 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:03:56.927899 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-301d3237-fb45-456b-8f26-1a4b71905a27 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14f57dd673f480c9984491a920fcacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b14dad85f52497c9819f0f3bb397f18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:03:56.935749 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-301d3237-fb45-456b-8f26-1a4b71905a27 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] 10.222.0.42 "GET /compute/v2.1/servers/6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17" status: 200 len: 1508 microversion: 2.1 time: 0.168283 Sep 16 02:03:56.936350 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 410/831] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:03:56 2022] GET /compute/v2.1/servers/6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17 => generated 1508 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 02:03:56.959478 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-56083bdc-4c44-4da0-90ba-4afea526cf6b tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "87d58081-bd3c-4874-b9ed-2895cd362714", "device": "/dev/sdb"}} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:03:56.961885 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-56083bdc-4c44-4da0-90ba-4afea526cf6b tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] [instance: 6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:03:56.968194 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-56083bdc-4c44-4da0-90ba-4afea526cf6b tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:03:56.968856 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-56083bdc-4c44-4da0-90ba-4afea526cf6b tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:03:56.969299 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-56083bdc-4c44-4da0-90ba-4afea526cf6b tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:03:56.969989 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-56083bdc-4c44-4da0-90ba-4afea526cf6b tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:03:56.970449 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-56083bdc-4c44-4da0-90ba-4afea526cf6b tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:03:56.970874 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-56083bdc-4c44-4da0-90ba-4afea526cf6b tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:03:57.230645 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-56083bdc-4c44-4da0-90ba-4afea526cf6b tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] 10.222.0.42 "POST /compute/v2.1/servers/6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.274981 Sep 16 02:03:57.231240 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 422/832] 10.222.0.42 () {60 vars in 1323 bytes} [Fri Sep 16 02:03:56 2022] POST /compute/v2.1/servers/6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17/os-volume_attachments => generated 194 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:03:59.045820 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-673e5bb4-c305-4e8b-9e77-f2d4c2aff495 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:03:59.048918 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-673e5bb4-c305-4e8b-9e77-f2d4c2aff495 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:03:59.055172 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-673e5bb4-c305-4e8b-9e77-f2d4c2aff495 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:03:59.055658 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-673e5bb4-c305-4e8b-9e77-f2d4c2aff495 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:03:59.056132 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-673e5bb4-c305-4e8b-9e77-f2d4c2aff495 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:03:59.056822 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-673e5bb4-c305-4e8b-9e77-f2d4c2aff495 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:03:59.057279 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-673e5bb4-c305-4e8b-9e77-f2d4c2aff495 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:03:59.057734 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-673e5bb4-c305-4e8b-9e77-f2d4c2aff495 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:03:59.089506 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-673e5bb4-c305-4e8b-9e77-f2d4c2aff495 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.047558 Sep 16 02:03:59.090095 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 411/833] 10.222.0.42 () {60 vars in 1343 bytes} [Fri Sep 16 02:03:59 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:03:59.157461 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-900bed2b-6d81-4893-824e-cf9b992f100f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:03:59.158045 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-900bed2b-6d81-4893-824e-cf9b992f100f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:03:59.164114 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-900bed2b-6d81-4893-824e-cf9b992f100f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:03:59.164593 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-900bed2b-6d81-4893-824e-cf9b992f100f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:03:59.165025 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-900bed2b-6d81-4893-824e-cf9b992f100f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:03:59.165703 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-900bed2b-6d81-4893-824e-cf9b992f100f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:03:59.166149 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-900bed2b-6d81-4893-824e-cf9b992f100f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:03:59.166566 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-900bed2b-6d81-4893-824e-cf9b992f100f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:03:59.193928 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-900bed2b-6d81-4893-824e-cf9b992f100f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Going to try to terminate instance {{(pid=120441) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 02:03:59.277747 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-900bed2b-6d81-4893-824e-cf9b992f100f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 204 len: 0 microversion: 2.20 time: 0.125020 Sep 16 02:03:59.279490 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 423/834] 10.222.0.42 () {60 vars in 1280 bytes} [Fri Sep 16 02:03:59 2022] DELETE /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 0 bytes in 128 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 16 02:03:59.293552 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-2cb12c16-8946-44e4-af2a-093dab521ea0 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:03:59.298382 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-2cb12c16-8946-44e4-af2a-093dab521ea0 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:03:59.307336 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2cb12c16-8946-44e4-af2a-093dab521ea0 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:03:59.307917 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2cb12c16-8946-44e4-af2a-093dab521ea0 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:03:59.308630 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2cb12c16-8946-44e4-af2a-093dab521ea0 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:03:59.309433 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2cb12c16-8946-44e4-af2a-093dab521ea0 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:03:59.310101 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2cb12c16-8946-44e4-af2a-093dab521ea0 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:03:59.310739 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2cb12c16-8946-44e4-af2a-093dab521ea0 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:03:59.595200 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-2cb12c16-8946-44e4-af2a-093dab521ea0 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:03:59.603227 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-2cb12c16-8946-44e4-af2a-093dab521ea0 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:03:59.604709 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-2cb12c16-8946-44e4-af2a-093dab521ea0 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:03:59.605846 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-2cb12c16-8946-44e4-af2a-093dab521ea0 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1724 microversion: 2.20 time: 0.318396 Sep 16 02:03:59.606391 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 412/835] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:03:59 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1724 bytes in 321 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:04:00.633699 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-35b03e3b-fc07-449a-be7a-36bea6976744 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:04:00.634395 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-35b03e3b-fc07-449a-be7a-36bea6976744 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:04:00.641661 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-35b03e3b-fc07-449a-be7a-36bea6976744 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:00.642141 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-35b03e3b-fc07-449a-be7a-36bea6976744 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:00.642571 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-35b03e3b-fc07-449a-be7a-36bea6976744 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:00.643245 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-35b03e3b-fc07-449a-be7a-36bea6976744 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:00.643691 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-35b03e3b-fc07-449a-be7a-36bea6976744 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:00.644143 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-35b03e3b-fc07-449a-be7a-36bea6976744 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:00.777870 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-35b03e3b-fc07-449a-be7a-36bea6976744 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:00.786185 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-35b03e3b-fc07-449a-be7a-36bea6976744 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:00.787608 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-35b03e3b-fc07-449a-be7a-36bea6976744 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:00.788777 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-35b03e3b-fc07-449a-be7a-36bea6976744 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1724 microversion: 2.20 time: 0.159727 Sep 16 02:04:00.789329 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 424/836] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:04:00 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1724 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:04:01.814929 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-a9e48ad5-b42c-41ab-942e-fc34ffe16317 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:04:01.815537 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-a9e48ad5-b42c-41ab-942e-fc34ffe16317 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:04:01.822265 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a9e48ad5-b42c-41ab-942e-fc34ffe16317 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:01.822750 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a9e48ad5-b42c-41ab-942e-fc34ffe16317 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:01.823185 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a9e48ad5-b42c-41ab-942e-fc34ffe16317 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:01.823869 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a9e48ad5-b42c-41ab-942e-fc34ffe16317 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:01.824352 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a9e48ad5-b42c-41ab-942e-fc34ffe16317 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:01.824774 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a9e48ad5-b42c-41ab-942e-fc34ffe16317 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:02.107334 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-a9e48ad5-b42c-41ab-942e-fc34ffe16317 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:02.116040 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-a9e48ad5-b42c-41ab-942e-fc34ffe16317 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:02.117548 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-a9e48ad5-b42c-41ab-942e-fc34ffe16317 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:02.118701 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-a9e48ad5-b42c-41ab-942e-fc34ffe16317 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1724 microversion: 2.20 time: 0.307850 Sep 16 02:04:02.119245 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 413/837] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:04:01 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1724 bytes in 309 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:04:03.144534 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-84011b1f-d8c8-4891-abd1-18e0c2cab901 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:04:03.145140 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-84011b1f-d8c8-4891-abd1-18e0c2cab901 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:04:03.151512 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-84011b1f-d8c8-4891-abd1-18e0c2cab901 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:03.152019 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-84011b1f-d8c8-4891-abd1-18e0c2cab901 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:03.152460 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-84011b1f-d8c8-4891-abd1-18e0c2cab901 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:03.153139 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-84011b1f-d8c8-4891-abd1-18e0c2cab901 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:03.153588 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-84011b1f-d8c8-4891-abd1-18e0c2cab901 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:03.154036 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-84011b1f-d8c8-4891-abd1-18e0c2cab901 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:03.286716 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-84011b1f-d8c8-4891-abd1-18e0c2cab901 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:03.294625 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-84011b1f-d8c8-4891-abd1-18e0c2cab901 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:03.296100 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-84011b1f-d8c8-4891-abd1-18e0c2cab901 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:03.299006 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-84011b1f-d8c8-4891-abd1-18e0c2cab901 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1724 microversion: 2.20 time: 0.158380 Sep 16 02:04:03.299571 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 425/838] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:04:03 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1724 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:04:04.324140 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-35e51114-cb37-48c7-bb8a-054b3bd8377e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:04:04.324659 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-35e51114-cb37-48c7-bb8a-054b3bd8377e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:04:04.331247 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-35e51114-cb37-48c7-bb8a-054b3bd8377e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:04.331730 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-35e51114-cb37-48c7-bb8a-054b3bd8377e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:04.332202 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-35e51114-cb37-48c7-bb8a-054b3bd8377e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:04.332886 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-35e51114-cb37-48c7-bb8a-054b3bd8377e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:04.333373 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-35e51114-cb37-48c7-bb8a-054b3bd8377e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:04.333799 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-35e51114-cb37-48c7-bb8a-054b3bd8377e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:04.459498 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-35e51114-cb37-48c7-bb8a-054b3bd8377e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:04.467406 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-35e51114-cb37-48c7-bb8a-054b3bd8377e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:04.469008 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-35e51114-cb37-48c7-bb8a-054b3bd8377e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:04.470156 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-35e51114-cb37-48c7-bb8a-054b3bd8377e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1724 microversion: 2.20 time: 0.150030 Sep 16 02:04:04.470706 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 414/839] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:04:04 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:04:05.496320 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-2ae2da70-109b-41e0-b306-95f7e32d98ac tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:04:05.496919 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-2ae2da70-109b-41e0-b306-95f7e32d98ac tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:04:05.503682 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2ae2da70-109b-41e0-b306-95f7e32d98ac tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:05.504265 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2ae2da70-109b-41e0-b306-95f7e32d98ac tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:05.504697 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2ae2da70-109b-41e0-b306-95f7e32d98ac tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:05.505371 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2ae2da70-109b-41e0-b306-95f7e32d98ac tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:05.505815 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2ae2da70-109b-41e0-b306-95f7e32d98ac tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:05.506235 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2ae2da70-109b-41e0-b306-95f7e32d98ac tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:05.633407 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-2ae2da70-109b-41e0-b306-95f7e32d98ac tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:05.642132 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-2ae2da70-109b-41e0-b306-95f7e32d98ac tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:05.643549 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-2ae2da70-109b-41e0-b306-95f7e32d98ac tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:05.644715 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-2ae2da70-109b-41e0-b306-95f7e32d98ac tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1724 microversion: 2.20 time: 0.152269 Sep 16 02:04:05.645263 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 426/840] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:04:05 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1724 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:04:06.669397 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-75b8196b-cce4-4c76-9c09-820d1d694900 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:04:06.670014 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-75b8196b-cce4-4c76-9c09-820d1d694900 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:04:06.678277 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-75b8196b-cce4-4c76-9c09-820d1d694900 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:06.678764 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-75b8196b-cce4-4c76-9c09-820d1d694900 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:06.679201 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-75b8196b-cce4-4c76-9c09-820d1d694900 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:06.679898 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-75b8196b-cce4-4c76-9c09-820d1d694900 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:06.680377 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-75b8196b-cce4-4c76-9c09-820d1d694900 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:06.680941 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-75b8196b-cce4-4c76-9c09-820d1d694900 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:06.848472 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-75b8196b-cce4-4c76-9c09-820d1d694900 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:06.865719 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-75b8196b-cce4-4c76-9c09-820d1d694900 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:06.868245 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-75b8196b-cce4-4c76-9c09-820d1d694900 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:06.869793 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-75b8196b-cce4-4c76-9c09-820d1d694900 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1724 microversion: 2.20 time: 0.204164 Sep 16 02:04:06.870434 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 415/841] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:04:06 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1724 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:04:07.620238 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [req-e03589c1-8698-47b2-9ac6-48307a8f0a23 req-2d585e99-95b9-4162-93bd-2e73d6022491 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "3582769d-4f26-4b4d-b2d9-e9638db93366", "name": "network-vif-deleted", "tag": "4127457c-ae36-44e0-abd0-2ee3fefef488"}]} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:04:07.630949 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-e03589c1-8698-47b2-9ac6-48307a8f0a23 req-2d585e99-95b9-4162-93bd-2e73d6022491 service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:07.631422 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-e03589c1-8698-47b2-9ac6-48307a8f0a23 req-2d585e99-95b9-4162-93bd-2e73d6022491 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:07.631850 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-e03589c1-8698-47b2-9ac6-48307a8f0a23 req-2d585e99-95b9-4162-93bd-2e73d6022491 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:07.642779 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.compute.server_external_events [req-e03589c1-8698-47b2-9ac6-48307a8f0a23 req-2d585e99-95b9-4162-93bd-2e73d6022491 service nova] Creating event network-vif-deleted:4127457c-ae36-44e0-abd0-2ee3fefef488 for instance 3582769d-4f26-4b4d-b2d9-e9638db93366 on hv-cinder-84914 Sep 16 02:04:07.647779 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [req-e03589c1-8698-47b2-9ac6-48307a8f0a23 req-2d585e99-95b9-4162-93bd-2e73d6022491 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031239 Sep 16 02:04:07.648403 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 427/842] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:04:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:04:07.896830 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-b67185ed-eb6c-4849-b823-d9975b0dfc31 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:04:07.897458 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-b67185ed-eb6c-4849-b823-d9975b0dfc31 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:04:07.903913 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b67185ed-eb6c-4849-b823-d9975b0dfc31 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:07.904435 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b67185ed-eb6c-4849-b823-d9975b0dfc31 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:07.904878 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b67185ed-eb6c-4849-b823-d9975b0dfc31 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:07.906117 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b67185ed-eb6c-4849-b823-d9975b0dfc31 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:07.906668 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b67185ed-eb6c-4849-b823-d9975b0dfc31 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:07.907062 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b67185ed-eb6c-4849-b823-d9975b0dfc31 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:07.970894 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-b67185ed-eb6c-4849-b823-d9975b0dfc31 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:07.979504 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-b67185ed-eb6c-4849-b823-d9975b0dfc31 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:07.980970 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-b67185ed-eb6c-4849-b823-d9975b0dfc31 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:07.982187 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-b67185ed-eb6c-4849-b823-d9975b0dfc31 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1656 microversion: 2.20 time: 0.089392 Sep 16 02:04:07.982866 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 416/843] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:04:07 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1656 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:04:09.010220 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-12799a5b-00a5-4ebc-bd62-99cdf8a808a5 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:04:09.010911 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-12799a5b-00a5-4ebc-bd62-99cdf8a808a5 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:04:09.017158 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-12799a5b-00a5-4ebc-bd62-99cdf8a808a5 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:09.017632 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-12799a5b-00a5-4ebc-bd62-99cdf8a808a5 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:09.018061 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-12799a5b-00a5-4ebc-bd62-99cdf8a808a5 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:09.018734 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-12799a5b-00a5-4ebc-bd62-99cdf8a808a5 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:09.019182 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-12799a5b-00a5-4ebc-bd62-99cdf8a808a5 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:09.019603 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-12799a5b-00a5-4ebc-bd62-99cdf8a808a5 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:09.081612 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-12799a5b-00a5-4ebc-bd62-99cdf8a808a5 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:09.090355 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-12799a5b-00a5-4ebc-bd62-99cdf8a808a5 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:09.091801 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-12799a5b-00a5-4ebc-bd62-99cdf8a808a5 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:09.093276 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-12799a5b-00a5-4ebc-bd62-99cdf8a808a5 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1656 microversion: 2.20 time: 0.087528 Sep 16 02:04:09.094256 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 428/844] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:04:09 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1656 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:04:10.118865 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-85d5acaf-80cd-4d8d-8923-f6fbfed7711f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:04:10.119477 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-85d5acaf-80cd-4d8d-8923-f6fbfed7711f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:04:10.126896 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-85d5acaf-80cd-4d8d-8923-f6fbfed7711f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:10.127382 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-85d5acaf-80cd-4d8d-8923-f6fbfed7711f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:10.127867 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-85d5acaf-80cd-4d8d-8923-f6fbfed7711f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:10.128534 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-85d5acaf-80cd-4d8d-8923-f6fbfed7711f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:10.128991 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-85d5acaf-80cd-4d8d-8923-f6fbfed7711f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:10.129417 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-85d5acaf-80cd-4d8d-8923-f6fbfed7711f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:10.195998 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-85d5acaf-80cd-4d8d-8923-f6fbfed7711f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:10.198200 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell1:SELECT=89 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:04:10.206268 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-85d5acaf-80cd-4d8d-8923-f6fbfed7711f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:10.207708 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-85d5acaf-80cd-4d8d-8923-f6fbfed7711f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:10.208881 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-85d5acaf-80cd-4d8d-8923-f6fbfed7711f tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1656 microversion: 2.20 time: 0.093869 Sep 16 02:04:10.209420 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 417/845] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:04:10 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1656 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:04:11.236163 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-3b945d37-c0b3-47fd-8049-79e0f21aad2e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:04:11.237273 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-3b945d37-c0b3-47fd-8049-79e0f21aad2e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:04:11.241037 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_api:SELECT=49,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:04:11.246145 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3b945d37-c0b3-47fd-8049-79e0f21aad2e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:11.246652 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3b945d37-c0b3-47fd-8049-79e0f21aad2e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:11.247134 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3b945d37-c0b3-47fd-8049-79e0f21aad2e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:11.247849 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3b945d37-c0b3-47fd-8049-79e0f21aad2e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:11.248331 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3b945d37-c0b3-47fd-8049-79e0f21aad2e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:11.248747 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3b945d37-c0b3-47fd-8049-79e0f21aad2e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:11.254112 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:04:11.329137 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-3b945d37-c0b3-47fd-8049-79e0f21aad2e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:11.337400 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-3b945d37-c0b3-47fd-8049-79e0f21aad2e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:11.340142 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-3b945d37-c0b3-47fd-8049-79e0f21aad2e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': 'dd95ef263d15460f9cca5a7557cbee2e', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '1377f60423c64a1786203deb55ae55ef', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:11.341320 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-3b945d37-c0b3-47fd-8049-79e0f21aad2e tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 200 len: 1365 microversion: 2.20 time: 0.110738 Sep 16 02:04:11.341860 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 429/846] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:04:11 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 1365 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 02:04:12.369761 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-886f5953-6a6e-460e-b632-a4755d43caed tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:04:12.370381 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-886f5953-6a6e-460e-b632-a4755d43caed tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:04:12.377599 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_api:SELECT=35 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:04:12.384471 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-886f5953-6a6e-460e-b632-a4755d43caed tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:12.385065 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-886f5953-6a6e-460e-b632-a4755d43caed tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:12.385489 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-886f5953-6a6e-460e-b632-a4755d43caed tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:12.386324 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-886f5953-6a6e-460e-b632-a4755d43caed tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:12.386779 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-886f5953-6a6e-460e-b632-a4755d43caed tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:12.387265 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-886f5953-6a6e-460e-b632-a4755d43caed tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:12.407264 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.wsgi [None req-886f5953-6a6e-460e-b632-a4755d43caed tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] HTTP exception thrown: Instance 3582769d-4f26-4b4d-b2d9-e9638db93366 could not be found. Sep 16 02:04:12.409156 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-886f5953-6a6e-460e-b632-a4755d43caed tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Request method failure captured: Sep 16 02:04:12.409156 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: request: GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 HTTP/1.1 Sep 16 02:04:12.409156 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept: application/json Sep 16 02:04:12.409156 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept-Encoding: identity Sep 16 02:04:12.409156 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Connection: close Sep 16 02:04:12.409156 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Length: 0 Sep 16 02:04:12.409156 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Type: application/json Sep 16 02:04:12.409156 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Host: 10.222.0.42 Sep 16 02:04:12.409156 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Openstack-System-Scope: None Sep 16 02:04:12.409156 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: User-Agent: python-urllib3/1.26.12 Sep 16 02:04:12.409156 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Auth-Token: gAAAAABjI9c44XauSCW-l4VA0O-h9qlJRhm6qcbICunUoHrFT4-QwVCyMa6SNEM6ALN1WCZA4M1vQ-Pz1dpN0-7E5dsSrv6OvjIJkpEgILOZoYFEFnJbJ0ig42KuV1P3aDuoOZUNY3HiqsAqqaFuZFyDieW3vfVRtVQ8D0Leui0aNPQ8OZDgYDI Sep 16 02:04:12.409156 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Id: None Sep 16 02:04:12.409156 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Name: None Sep 16 02:04:12.409156 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Identity-Status: Confirmed Sep 16 02:04:12.409156 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Is-Admin-Project: True Sep 16 02:04:12.409156 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Openstack-Nova-Api-Version: 2.20 Sep 16 02:04:12.409156 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Id: default Sep 16 02:04:12.409156 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Name: Default Sep 16 02:04:12.409156 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Id: 1377f60423c64a1786203deb55ae55ef Sep 16 02:04:12.409156 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1249782334 Sep 16 02:04:12.409156 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Role: member,reader Sep 16 02:04:12.409156 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Roles: member,reader Sep 16 02:04:12.410950 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1377f60423c64a1786203deb55ae55ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1377f60423c64a1786203deb55ae55ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1377f60423c64a1786203deb55ae55ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1377f60423c64a1786203deb55ae55ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 02:04:12.410950 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1249782334 Sep 16 02:04:12.410950 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Id: 1377f60423c64a1786203deb55ae55ef Sep 16 02:04:12.410950 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1249782334 Sep 16 02:04:12.410950 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User: tempest-AttachVolumeShelveTestJSON-1249782334-project Sep 16 02:04:12.410950 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Id: default Sep 16 02:04:12.410950 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Name: Default Sep 16 02:04:12.410950 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Id: dd95ef263d15460f9cca5a7557cbee2e Sep 16 02:04:12.410950 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1249782334-project Sep 16 02:04:12.410950 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: method: > Sep 16 02:04:12.410950 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: exception: Instance 3582769d-4f26-4b4d-b2d9-e9638db93366 could not be found. Sep 16 02:04:12.410950 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: action_args: {'id': '3582769d-4f26-4b4d-b2d9-e9638db93366'} Sep 16 02:04:12.411812 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 02:04:12.411812 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:04:12.411812 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 02:04:12.411812 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 02:04:12.411812 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 02:04:12.411812 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 02:04:12.411812 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 02:04:12.411812 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 02:04:12.411812 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 02:04:12.411812 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 02:04:12.411812 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3582769d-4f26-4b4d-b2d9-e9638db93366 could not be found. Sep 16 02:04:12.411812 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:04:12.411812 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:04:12.411812 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:04:12.411812 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:04:12.411812 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:04:12.411812 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:04:12.411812 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 02:04:12.411812 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 02:04:12.411812 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 02:04:12.413324 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 02:04:12.413324 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 02:04:12.413324 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 02:04:12.413324 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 02:04:12.413324 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 02:04:12.413324 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 02:04:12.413324 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 02:04:12.413324 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3582769d-4f26-4b4d-b2d9-e9638db93366 could not be found. Sep 16 02:04:12.413324 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:04:12.413324 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:04:12.413324 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:04:12.413324 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:04:12.413324 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:04:12.413324 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:04:12.413324 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 02:04:12.413324 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 02:04:12.413324 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3582769d-4f26-4b4d-b2d9-e9638db93366 could not be found. Sep 16 02:04:12.413324 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:04:12.415133 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-886f5953-6a6e-460e-b632-a4755d43caed tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Returning 404 to user: Instance 3582769d-4f26-4b4d-b2d9-e9638db93366 could not be found. {{(pid=120440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 02:04:12.415133 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-886f5953-6a6e-460e-b632-a4755d43caed tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 404 len: 111 microversion: 2.20 time: 0.045053 Sep 16 02:04:12.415133 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 418/847] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:04:12 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 02:04:12.420086 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-177262dc-6801-4a79-b0a1-9968d8a3e92b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '.version_select at 0x7fae3625d0d0>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:04:12.440828 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-177262dc-6801-4a79-b0a1-9968d8a3e92b tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-619814303" status: 204 len: 0 microversion: 2.20 time: 0.024580 Sep 16 02:04:12.441410 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 430/848] 10.222.0.42 () {60 vars in 1259 bytes} [Fri Sep 16 02:04:12 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-619814303 => generated 0 bytes in 26 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 16 02:04:18.577696 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-fe7ccd85-bb36-4339-bf33-759f4e7bb9ac tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:04:18.578769 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-fe7ccd85-bb36-4339-bf33-759f4e7bb9ac tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:04:18.585701 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-fe7ccd85-bb36-4339-bf33-759f4e7bb9ac tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:18.586293 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-fe7ccd85-bb36-4339-bf33-759f4e7bb9ac tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:18.586858 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-fe7ccd85-bb36-4339-bf33-759f4e7bb9ac tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:18.587904 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-fe7ccd85-bb36-4339-bf33-759f4e7bb9ac tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:18.588463 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-fe7ccd85-bb36-4339-bf33-759f4e7bb9ac tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:18.589113 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-fe7ccd85-bb36-4339-bf33-759f4e7bb9ac tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:18.604496 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.wsgi [None req-fe7ccd85-bb36-4339-bf33-759f4e7bb9ac tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] HTTP exception thrown: Instance 3582769d-4f26-4b4d-b2d9-e9638db93366 could not be found. Sep 16 02:04:18.606054 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-fe7ccd85-bb36-4339-bf33-759f4e7bb9ac tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Request method failure captured: Sep 16 02:04:18.606054 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: request: DELETE /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 HTTP/1.1 Sep 16 02:04:18.606054 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept: application/json Sep 16 02:04:18.606054 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept-Encoding: identity Sep 16 02:04:18.606054 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Connection: close Sep 16 02:04:18.606054 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Length: 0 Sep 16 02:04:18.606054 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Type: application/json Sep 16 02:04:18.606054 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Host: 10.222.0.42 Sep 16 02:04:18.606054 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Openstack-System-Scope: None Sep 16 02:04:18.606054 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: User-Agent: python-urllib3/1.26.12 Sep 16 02:04:18.606054 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Auth-Token: gAAAAABjI9c44XauSCW-l4VA0O-h9qlJRhm6qcbICunUoHrFT4-QwVCyMa6SNEM6ALN1WCZA4M1vQ-Pz1dpN0-7E5dsSrv6OvjIJkpEgILOZoYFEFnJbJ0ig42KuV1P3aDuoOZUNY3HiqsAqqaFuZFyDieW3vfVRtVQ8D0Leui0aNPQ8OZDgYDI Sep 16 02:04:18.606054 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Id: None Sep 16 02:04:18.606054 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Name: None Sep 16 02:04:18.606054 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Identity-Status: Confirmed Sep 16 02:04:18.606054 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Is-Admin-Project: True Sep 16 02:04:18.606054 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Openstack-Nova-Api-Version: 2.20 Sep 16 02:04:18.606054 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Id: default Sep 16 02:04:18.606054 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Name: Default Sep 16 02:04:18.606054 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Id: 1377f60423c64a1786203deb55ae55ef Sep 16 02:04:18.606054 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1249782334 Sep 16 02:04:18.606054 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Role: member,reader Sep 16 02:04:18.606054 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Roles: member,reader Sep 16 02:04:18.607897 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1377f60423c64a1786203deb55ae55ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1377f60423c64a1786203deb55ae55ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1377f60423c64a1786203deb55ae55ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1377f60423c64a1786203deb55ae55ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 02:04:18.607897 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1249782334 Sep 16 02:04:18.607897 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Id: 1377f60423c64a1786203deb55ae55ef Sep 16 02:04:18.607897 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1249782334 Sep 16 02:04:18.607897 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User: tempest-AttachVolumeShelveTestJSON-1249782334-project Sep 16 02:04:18.607897 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Id: default Sep 16 02:04:18.607897 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Name: Default Sep 16 02:04:18.607897 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Id: dd95ef263d15460f9cca5a7557cbee2e Sep 16 02:04:18.607897 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1249782334-project Sep 16 02:04:18.607897 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: method: > Sep 16 02:04:18.607897 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: exception: Instance 3582769d-4f26-4b4d-b2d9-e9638db93366 could not be found. Sep 16 02:04:18.607897 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: action_args: {'id': '3582769d-4f26-4b4d-b2d9-e9638db93366'} Sep 16 02:04:18.609765 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 02:04:18.609765 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:04:18.609765 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 02:04:18.609765 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 02:04:18.609765 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 02:04:18.609765 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 02:04:18.609765 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 02:04:18.609765 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 02:04:18.609765 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 02:04:18.609765 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 02:04:18.609765 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3582769d-4f26-4b4d-b2d9-e9638db93366 could not be found. Sep 16 02:04:18.609765 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:04:18.609765 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:04:18.609765 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:04:18.609765 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:04:18.609765 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:04:18.609765 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:04:18.609765 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 02:04:18.609765 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 02:04:18.609765 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 02:04:18.611645 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 02:04:18.611645 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 02:04:18.611645 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 02:04:18.611645 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 02:04:18.611645 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 02:04:18.611645 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 02:04:18.611645 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 02:04:18.611645 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 02:04:18.611645 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 02:04:18.611645 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3582769d-4f26-4b4d-b2d9-e9638db93366 could not be found. Sep 16 02:04:18.611645 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:04:18.611645 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:04:18.611645 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:04:18.611645 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:04:18.611645 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:04:18.611645 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:04:18.611645 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 02:04:18.611645 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 02:04:18.611645 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3582769d-4f26-4b4d-b2d9-e9638db93366 could not be found. Sep 16 02:04:18.611645 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:04:18.613430 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-fe7ccd85-bb36-4339-bf33-759f4e7bb9ac tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Returning 404 to user: Instance 3582769d-4f26-4b4d-b2d9-e9638db93366 could not be found. {{(pid=120440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 02:04:18.613430 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-fe7ccd85-bb36-4339-bf33-759f4e7bb9ac tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 404 len: 111 microversion: 2.20 time: 0.034212 Sep 16 02:04:18.613430 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 419/849] 10.222.0.42 () {60 vars in 1280 bytes} [Fri Sep 16 02:04:18 2022] DELETE /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 02:04:18.617988 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-2bbfbc6a-7e12-405a-a0dc-c80ffccb5b3d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:04:18.618598 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-2bbfbc6a-7e12-405a-a0dc-c80ffccb5b3d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3582769d-4f26-4b4d-b2d9-e9638db93366] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:04:18.625842 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2bbfbc6a-7e12-405a-a0dc-c80ffccb5b3d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:18.626328 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2bbfbc6a-7e12-405a-a0dc-c80ffccb5b3d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:18.626759 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2bbfbc6a-7e12-405a-a0dc-c80ffccb5b3d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:18.627443 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2bbfbc6a-7e12-405a-a0dc-c80ffccb5b3d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:18.627893 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2bbfbc6a-7e12-405a-a0dc-c80ffccb5b3d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:18.628344 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2bbfbc6a-7e12-405a-a0dc-c80ffccb5b3d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:18.642077 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.wsgi [None req-2bbfbc6a-7e12-405a-a0dc-c80ffccb5b3d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] HTTP exception thrown: Instance 3582769d-4f26-4b4d-b2d9-e9638db93366 could not be found. Sep 16 02:04:18.643832 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-2bbfbc6a-7e12-405a-a0dc-c80ffccb5b3d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Request method failure captured: Sep 16 02:04:18.643832 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: request: GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 HTTP/1.1 Sep 16 02:04:18.643832 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Accept: application/json Sep 16 02:04:18.643832 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Accept-Encoding: identity Sep 16 02:04:18.643832 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Connection: close Sep 16 02:04:18.643832 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Content-Length: 0 Sep 16 02:04:18.643832 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Content-Type: application/json Sep 16 02:04:18.643832 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Host: 10.222.0.42 Sep 16 02:04:18.643832 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Openstack-System-Scope: None Sep 16 02:04:18.643832 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: User-Agent: python-urllib3/1.26.12 Sep 16 02:04:18.643832 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Auth-Token: gAAAAABjI9c44XauSCW-l4VA0O-h9qlJRhm6qcbICunUoHrFT4-QwVCyMa6SNEM6ALN1WCZA4M1vQ-Pz1dpN0-7E5dsSrv6OvjIJkpEgILOZoYFEFnJbJ0ig42KuV1P3aDuoOZUNY3HiqsAqqaFuZFyDieW3vfVRtVQ8D0Leui0aNPQ8OZDgYDI Sep 16 02:04:18.643832 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Domain-Id: None Sep 16 02:04:18.643832 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Domain-Name: None Sep 16 02:04:18.643832 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Identity-Status: Confirmed Sep 16 02:04:18.643832 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Is-Admin-Project: True Sep 16 02:04:18.643832 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Openstack-Nova-Api-Version: 2.20 Sep 16 02:04:18.643832 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Domain-Id: default Sep 16 02:04:18.643832 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Domain-Name: Default Sep 16 02:04:18.643832 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Id: 1377f60423c64a1786203deb55ae55ef Sep 16 02:04:18.643832 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1249782334 Sep 16 02:04:18.643832 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Role: member,reader Sep 16 02:04:18.643832 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Roles: member,reader Sep 16 02:04:18.645197 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1377f60423c64a1786203deb55ae55ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1377f60423c64a1786203deb55ae55ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1377f60423c64a1786203deb55ae55ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1377f60423c64a1786203deb55ae55ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 02:04:18.645197 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1249782334 Sep 16 02:04:18.645197 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant-Id: 1377f60423c64a1786203deb55ae55ef Sep 16 02:04:18.645197 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1249782334 Sep 16 02:04:18.645197 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User: tempest-AttachVolumeShelveTestJSON-1249782334-project Sep 16 02:04:18.645197 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Domain-Id: default Sep 16 02:04:18.645197 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Domain-Name: Default Sep 16 02:04:18.645197 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Id: dd95ef263d15460f9cca5a7557cbee2e Sep 16 02:04:18.645197 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1249782334-project Sep 16 02:04:18.645197 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: method: > Sep 16 02:04:18.645197 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: exception: Instance 3582769d-4f26-4b4d-b2d9-e9638db93366 could not be found. Sep 16 02:04:18.645197 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: action_args: {'id': '3582769d-4f26-4b4d-b2d9-e9638db93366'} Sep 16 02:04:18.645989 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 02:04:18.645989 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:04:18.645989 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 02:04:18.645989 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 02:04:18.645989 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 02:04:18.645989 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 02:04:18.645989 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 02:04:18.645989 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 02:04:18.645989 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 02:04:18.645989 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 02:04:18.645989 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3582769d-4f26-4b4d-b2d9-e9638db93366 could not be found. Sep 16 02:04:18.645989 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:04:18.645989 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:04:18.645989 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:04:18.645989 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:04:18.645989 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:04:18.645989 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:04:18.645989 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 02:04:18.645989 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 02:04:18.645989 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 02:04:18.647143 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 02:04:18.647143 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 02:04:18.647143 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 02:04:18.647143 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 02:04:18.647143 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 02:04:18.647143 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 02:04:18.647143 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 02:04:18.647143 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3582769d-4f26-4b4d-b2d9-e9638db93366 could not be found. Sep 16 02:04:18.647143 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:04:18.647143 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:04:18.647143 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:04:18.647143 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:04:18.647143 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:04:18.647143 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:04:18.647143 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 02:04:18.647143 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 02:04:18.647143 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3582769d-4f26-4b4d-b2d9-e9638db93366 could not be found. Sep 16 02:04:18.647143 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:04:18.648730 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-2bbfbc6a-7e12-405a-a0dc-c80ffccb5b3d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Returning 404 to user: Instance 3582769d-4f26-4b4d-b2d9-e9638db93366 could not be found. {{(pid=120441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 02:04:18.648730 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-2bbfbc6a-7e12-405a-a0dc-c80ffccb5b3d tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366" status: 404 len: 111 microversion: 2.20 time: 0.031864 Sep 16 02:04:18.648730 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 431/850] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:04:18 2022] GET /compute/v2.1/servers/3582769d-4f26-4b4d-b2d9-e9638db93366 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 02:04:19.822351 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-9b5d9799-61a2-4dbc-bd9d-d8d3725acb78 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:04:19.822866 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-9b5d9799-61a2-4dbc-bd9d-d8d3725acb78 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:04:19.829446 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9b5d9799-61a2-4dbc-bd9d-d8d3725acb78 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:19.829922 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9b5d9799-61a2-4dbc-bd9d-d8d3725acb78 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:19.830358 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9b5d9799-61a2-4dbc-bd9d-d8d3725acb78 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:19.831237 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9b5d9799-61a2-4dbc-bd9d-d8d3725acb78 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:19.831694 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9b5d9799-61a2-4dbc-bd9d-d8d3725acb78 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:19.832147 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9b5d9799-61a2-4dbc-bd9d-d8d3725acb78 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:19.865018 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.wsgi [None req-9b5d9799-61a2-4dbc-bd9d-d8d3725acb78 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] HTTP exception thrown: Instance 3e390b45-0b39-4429-9431-7ee6af3806e6 could not be found. Sep 16 02:04:19.866530 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-9b5d9799-61a2-4dbc-bd9d-d8d3725acb78 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Request method failure captured: Sep 16 02:04:19.866530 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: request: DELETE /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 HTTP/1.1 Sep 16 02:04:19.866530 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept: application/json Sep 16 02:04:19.866530 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept-Encoding: identity Sep 16 02:04:19.866530 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Connection: close Sep 16 02:04:19.866530 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Length: 0 Sep 16 02:04:19.866530 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Type: application/json Sep 16 02:04:19.866530 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Host: 10.222.0.42 Sep 16 02:04:19.866530 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Openstack-System-Scope: None Sep 16 02:04:19.866530 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: User-Agent: python-urllib3/1.26.12 Sep 16 02:04:19.866530 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Auth-Token: gAAAAABjI9c44XauSCW-l4VA0O-h9qlJRhm6qcbICunUoHrFT4-QwVCyMa6SNEM6ALN1WCZA4M1vQ-Pz1dpN0-7E5dsSrv6OvjIJkpEgILOZoYFEFnJbJ0ig42KuV1P3aDuoOZUNY3HiqsAqqaFuZFyDieW3vfVRtVQ8D0Leui0aNPQ8OZDgYDI Sep 16 02:04:19.866530 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Id: None Sep 16 02:04:19.866530 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Name: None Sep 16 02:04:19.866530 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Identity-Status: Confirmed Sep 16 02:04:19.866530 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Is-Admin-Project: True Sep 16 02:04:19.866530 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Openstack-Nova-Api-Version: 2.20 Sep 16 02:04:19.866530 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Id: default Sep 16 02:04:19.866530 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Name: Default Sep 16 02:04:19.866530 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Id: 1377f60423c64a1786203deb55ae55ef Sep 16 02:04:19.866530 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1249782334 Sep 16 02:04:19.866530 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Role: member,reader Sep 16 02:04:19.866530 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Roles: member,reader Sep 16 02:04:19.867976 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1377f60423c64a1786203deb55ae55ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1377f60423c64a1786203deb55ae55ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1377f60423c64a1786203deb55ae55ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1377f60423c64a1786203deb55ae55ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 02:04:19.867976 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1249782334 Sep 16 02:04:19.867976 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Id: 1377f60423c64a1786203deb55ae55ef Sep 16 02:04:19.867976 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1249782334 Sep 16 02:04:19.867976 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User: tempest-AttachVolumeShelveTestJSON-1249782334-project Sep 16 02:04:19.867976 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Id: default Sep 16 02:04:19.867976 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Name: Default Sep 16 02:04:19.867976 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Id: dd95ef263d15460f9cca5a7557cbee2e Sep 16 02:04:19.867976 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1249782334-project Sep 16 02:04:19.867976 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: method: > Sep 16 02:04:19.867976 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: exception: Instance 3e390b45-0b39-4429-9431-7ee6af3806e6 could not be found. Sep 16 02:04:19.867976 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: action_args: {'id': '3e390b45-0b39-4429-9431-7ee6af3806e6'} Sep 16 02:04:19.868708 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 02:04:19.868708 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:04:19.868708 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 02:04:19.868708 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 02:04:19.868708 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 02:04:19.868708 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 02:04:19.868708 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 02:04:19.868708 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 02:04:19.868708 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 02:04:19.868708 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 02:04:19.868708 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e390b45-0b39-4429-9431-7ee6af3806e6 could not be found. Sep 16 02:04:19.868708 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:04:19.868708 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:04:19.868708 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:04:19.868708 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:04:19.868708 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:04:19.868708 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:04:19.868708 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 02:04:19.868708 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 02:04:19.868708 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 02:04:19.870407 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 02:04:19.870407 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 02:04:19.870407 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 02:04:19.870407 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 02:04:19.870407 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 02:04:19.870407 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 02:04:19.870407 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 02:04:19.870407 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 02:04:19.870407 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 02:04:19.870407 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e390b45-0b39-4429-9431-7ee6af3806e6 could not be found. Sep 16 02:04:19.870407 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:04:19.870407 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:04:19.870407 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:04:19.870407 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:04:19.870407 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:04:19.870407 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:04:19.870407 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 02:04:19.870407 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 02:04:19.870407 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e390b45-0b39-4429-9431-7ee6af3806e6 could not be found. Sep 16 02:04:19.870407 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:04:19.873072 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-9b5d9799-61a2-4dbc-bd9d-d8d3725acb78 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Returning 404 to user: Instance 3e390b45-0b39-4429-9431-7ee6af3806e6 could not be found. {{(pid=120440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 02:04:19.873072 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-9b5d9799-61a2-4dbc-bd9d-d8d3725acb78 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "DELETE /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 404 len: 111 microversion: 2.20 time: 0.049398 Sep 16 02:04:19.876084 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 420/851] 10.222.0.42 () {60 vars in 1280 bytes} [Fri Sep 16 02:04:19 2022] DELETE /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 02:04:19.877657 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-f688cbb5-dc09-4126-bb48-14d7a532e229 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:04:19.878274 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-f688cbb5-dc09-4126-bb48-14d7a532e229 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] [instance: 3e390b45-0b39-4429-9431-7ee6af3806e6] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:04:19.884799 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f688cbb5-dc09-4126-bb48-14d7a532e229 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:19.885275 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f688cbb5-dc09-4126-bb48-14d7a532e229 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:19.885713 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f688cbb5-dc09-4126-bb48-14d7a532e229 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:19.888514 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f688cbb5-dc09-4126-bb48-14d7a532e229 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:19.889125 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f688cbb5-dc09-4126-bb48-14d7a532e229 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:19.890594 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f688cbb5-dc09-4126-bb48-14d7a532e229 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:19.907571 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.wsgi [None req-f688cbb5-dc09-4126-bb48-14d7a532e229 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] HTTP exception thrown: Instance 3e390b45-0b39-4429-9431-7ee6af3806e6 could not be found. Sep 16 02:04:19.909341 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-f688cbb5-dc09-4126-bb48-14d7a532e229 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Request method failure captured: Sep 16 02:04:19.909341 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: request: GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 HTTP/1.1 Sep 16 02:04:19.909341 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Accept: application/json Sep 16 02:04:19.909341 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Accept-Encoding: identity Sep 16 02:04:19.909341 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Connection: close Sep 16 02:04:19.909341 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Content-Length: 0 Sep 16 02:04:19.909341 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Content-Type: application/json Sep 16 02:04:19.909341 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Host: 10.222.0.42 Sep 16 02:04:19.909341 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Openstack-System-Scope: None Sep 16 02:04:19.909341 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: User-Agent: python-urllib3/1.26.12 Sep 16 02:04:19.909341 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Auth-Token: gAAAAABjI9c44XauSCW-l4VA0O-h9qlJRhm6qcbICunUoHrFT4-QwVCyMa6SNEM6ALN1WCZA4M1vQ-Pz1dpN0-7E5dsSrv6OvjIJkpEgILOZoYFEFnJbJ0ig42KuV1P3aDuoOZUNY3HiqsAqqaFuZFyDieW3vfVRtVQ8D0Leui0aNPQ8OZDgYDI Sep 16 02:04:19.909341 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Domain-Id: None Sep 16 02:04:19.909341 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Domain-Name: None Sep 16 02:04:19.909341 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Identity-Status: Confirmed Sep 16 02:04:19.909341 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Is-Admin-Project: True Sep 16 02:04:19.909341 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Openstack-Nova-Api-Version: 2.20 Sep 16 02:04:19.909341 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Domain-Id: default Sep 16 02:04:19.909341 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Domain-Name: Default Sep 16 02:04:19.909341 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Id: 1377f60423c64a1786203deb55ae55ef Sep 16 02:04:19.909341 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1249782334 Sep 16 02:04:19.909341 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Role: member,reader Sep 16 02:04:19.909341 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Roles: member,reader Sep 16 02:04:19.910677 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/1377f60423c64a1786203deb55ae55ef"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1377f60423c64a1786203deb55ae55ef"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_1377f60423c64a1786203deb55ae55ef"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/1377f60423c64a1786203deb55ae55ef"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 02:04:19.910677 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1249782334 Sep 16 02:04:19.910677 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant-Id: 1377f60423c64a1786203deb55ae55ef Sep 16 02:04:19.910677 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1249782334 Sep 16 02:04:19.910677 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User: tempest-AttachVolumeShelveTestJSON-1249782334-project Sep 16 02:04:19.910677 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Domain-Id: default Sep 16 02:04:19.910677 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Domain-Name: Default Sep 16 02:04:19.910677 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Id: dd95ef263d15460f9cca5a7557cbee2e Sep 16 02:04:19.910677 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1249782334-project Sep 16 02:04:19.910677 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: method: > Sep 16 02:04:19.910677 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: exception: Instance 3e390b45-0b39-4429-9431-7ee6af3806e6 could not be found. Sep 16 02:04:19.910677 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: action_args: {'id': '3e390b45-0b39-4429-9431-7ee6af3806e6'} Sep 16 02:04:19.911409 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 02:04:19.911409 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:04:19.911409 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 02:04:19.911409 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 02:04:19.911409 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 02:04:19.911409 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 02:04:19.911409 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 02:04:19.911409 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 02:04:19.911409 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 02:04:19.911409 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 02:04:19.911409 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 3e390b45-0b39-4429-9431-7ee6af3806e6 could not be found. Sep 16 02:04:19.911409 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:04:19.911409 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:04:19.911409 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:04:19.911409 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:04:19.911409 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:04:19.911409 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:04:19.911409 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 02:04:19.911409 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 02:04:19.911409 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 02:04:19.913507 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 02:04:19.913507 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 02:04:19.913507 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 02:04:19.913507 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 02:04:19.913507 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 02:04:19.913507 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 02:04:19.913507 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 02:04:19.913507 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 3e390b45-0b39-4429-9431-7ee6af3806e6 could not be found. Sep 16 02:04:19.913507 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:04:19.913507 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:04:19.913507 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:04:19.913507 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:04:19.913507 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:04:19.913507 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:04:19.913507 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 02:04:19.913507 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 02:04:19.913507 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 3e390b45-0b39-4429-9431-7ee6af3806e6 could not be found. Sep 16 02:04:19.913507 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:04:19.915219 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-f688cbb5-dc09-4126-bb48-14d7a532e229 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] Returning 404 to user: Instance 3e390b45-0b39-4429-9431-7ee6af3806e6 could not be found. {{(pid=120441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 02:04:19.915219 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-f688cbb5-dc09-4126-bb48-14d7a532e229 tempest-AttachVolumeShelveTestJSON-1249782334 tempest-AttachVolumeShelveTestJSON-1249782334-project] 10.222.0.42 "GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6" status: 404 len: 111 microversion: 2.20 time: 0.037789 Sep 16 02:04:19.915219 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 432/852] 10.222.0.42 () {60 vars in 1277 bytes} [Fri Sep 16 02:04:19 2022] GET /compute/v2.1/servers/3e390b45-0b39-4429-9431-7ee6af3806e6 => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 02:04:21.082220 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-66efe8ed-aa3c-484f-9bc9-66205e441bf8 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:04:21.082861 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-66efe8ed-aa3c-484f-9bc9-66205e441bf8 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] [instance: 6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:04:21.096145 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-66efe8ed-aa3c-484f-9bc9-66205e441bf8 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:21.096679 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-66efe8ed-aa3c-484f-9bc9-66205e441bf8 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:21.097439 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-66efe8ed-aa3c-484f-9bc9-66205e441bf8 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:21.099789 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-66efe8ed-aa3c-484f-9bc9-66205e441bf8 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:21.108482 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-66efe8ed-aa3c-484f-9bc9-66205e441bf8 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:21.109059 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-66efe8ed-aa3c-484f-9bc9-66205e441bf8 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:21.345881 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.objects.instance [None req-66efe8ed-aa3c-484f-9bc9-66205e441bf8 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lazy-loading 'services' on Instance uuid 6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17 {{(pid=120440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 02:04:21.496402 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-66efe8ed-aa3c-484f-9bc9-66205e441bf8 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17/os-volume_attachments/87d58081-bd3c-4874-b9ed-2895cd362714" status: 202 len: 0 microversion: 2.1 time: 0.417592 Sep 16 02:04:21.497009 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 421/853] 10.222.0.42 () {58 vars in 1416 bytes} [Fri Sep 16 02:04:21 2022] DELETE /compute/v2.1/servers/6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17/os-volume_attachments/87d58081-bd3c-4874-b9ed-2895cd362714 => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 02:04:22.719308 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-27b7e288-0739-4ab9-8069-6b3dedf03e89 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:04:22.720610 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-27b7e288-0739-4ab9-8069-6b3dedf03e89 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] [instance: 6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:04:22.730169 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-27b7e288-0739-4ab9-8069-6b3dedf03e89 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:22.731060 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-27b7e288-0739-4ab9-8069-6b3dedf03e89 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:22.731717 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-27b7e288-0739-4ab9-8069-6b3dedf03e89 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:22.732717 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-27b7e288-0739-4ab9-8069-6b3dedf03e89 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:22.735640 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-27b7e288-0739-4ab9-8069-6b3dedf03e89 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:22.736735 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-27b7e288-0739-4ab9-8069-6b3dedf03e89 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:22.813891 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-27b7e288-0739-4ab9-8069-6b3dedf03e89 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] [instance: 6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17] Going to try to terminate instance {{(pid=120441) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 02:04:22.942179 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-27b7e288-0739-4ab9-8069-6b3dedf03e89 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17" status: 204 len: 0 microversion: 2.1 time: 0.228095 Sep 16 02:04:22.953734 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-17839105-d371-4d9c-b566-915990c9acf4 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:04:22.954356 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 433/854] 10.222.0.42 () {58 vars in 1239 bytes} [Fri Sep 16 02:04:22 2022] DELETE /compute/v2.1/servers/6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17 => generated 0 bytes in 231 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 02:04:22.955131 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-17839105-d371-4d9c-b566-915990c9acf4 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] [instance: 6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:04:22.970658 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-17839105-d371-4d9c-b566-915990c9acf4 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:22.971436 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-17839105-d371-4d9c-b566-915990c9acf4 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:22.972089 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-17839105-d371-4d9c-b566-915990c9acf4 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:22.972961 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-17839105-d371-4d9c-b566-915990c9acf4 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:22.973889 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-17839105-d371-4d9c-b566-915990c9acf4 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:22.974238 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-17839105-d371-4d9c-b566-915990c9acf4 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:23.224596 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-17839105-d371-4d9c-b566-915990c9acf4 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14f57dd673f480c9984491a920fcacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b14dad85f52497c9819f0f3bb397f18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:23.239183 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-17839105-d371-4d9c-b566-915990c9acf4 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] 10.222.0.42 "GET /compute/v2.1/servers/6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17" status: 200 len: 1514 microversion: 2.1 time: 0.289444 Sep 16 02:04:23.244823 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 422/855] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:04:22 2022] GET /compute/v2.1/servers/6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17 => generated 1514 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:04:24.266399 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-743d3495-2f73-4221-bddf-3387af50b509 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:04:24.267964 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-743d3495-2f73-4221-bddf-3387af50b509 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] [instance: 6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:04:24.287882 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-743d3495-2f73-4221-bddf-3387af50b509 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:24.288410 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-743d3495-2f73-4221-bddf-3387af50b509 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:24.288877 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-743d3495-2f73-4221-bddf-3387af50b509 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:24.292634 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-743d3495-2f73-4221-bddf-3387af50b509 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:24.293441 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-743d3495-2f73-4221-bddf-3387af50b509 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:24.293721 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-743d3495-2f73-4221-bddf-3387af50b509 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:24.499360 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-743d3495-2f73-4221-bddf-3387af50b509 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14f57dd673f480c9984491a920fcacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b14dad85f52497c9819f0f3bb397f18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:24.508809 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-743d3495-2f73-4221-bddf-3387af50b509 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] 10.222.0.42 "GET /compute/v2.1/servers/6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17" status: 200 len: 1514 microversion: 2.1 time: 0.249412 Sep 16 02:04:24.509545 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 434/856] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:04:24 2022] GET /compute/v2.1/servers/6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17 => generated 1514 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:04:25.535329 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-8c0711f0-6c18-43b3-a871-d7f8c2f38c3f tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:04:25.547349 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-8c0711f0-6c18-43b3-a871-d7f8c2f38c3f tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] [instance: 6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:04:25.563237 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8c0711f0-6c18-43b3-a871-d7f8c2f38c3f tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:25.564271 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8c0711f0-6c18-43b3-a871-d7f8c2f38c3f tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:25.565193 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8c0711f0-6c18-43b3-a871-d7f8c2f38c3f tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:25.566130 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8c0711f0-6c18-43b3-a871-d7f8c2f38c3f tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:25.566738 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8c0711f0-6c18-43b3-a871-d7f8c2f38c3f tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:25.567377 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8c0711f0-6c18-43b3-a871-d7f8c2f38c3f tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:25.847968 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [req-0b4ff2d2-3fa1-4103-a3b7-32d504785655 req-f9496a1c-09e2-426c-8391-8cffbfa8dd93 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17", "name": "network-vif-deleted", "tag": "eaea4902-1bf6-48bb-9a86-81bc1df71766"}]} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:04:25.875689 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-0b4ff2d2-3fa1-4103-a3b7-32d504785655 req-f9496a1c-09e2-426c-8391-8cffbfa8dd93 service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:25.876194 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-0b4ff2d2-3fa1-4103-a3b7-32d504785655 req-f9496a1c-09e2-426c-8391-8cffbfa8dd93 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:25.876622 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-0b4ff2d2-3fa1-4103-a3b7-32d504785655 req-f9496a1c-09e2-426c-8391-8cffbfa8dd93 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:25.904341 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.compute.server_external_events [req-0b4ff2d2-3fa1-4103-a3b7-32d504785655 req-f9496a1c-09e2-426c-8391-8cffbfa8dd93 service nova] Creating event network-vif-deleted:eaea4902-1bf6-48bb-9a86-81bc1df71766 for instance 6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17 on hv-cinder-84914 Sep 16 02:04:25.914882 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-8c0711f0-6c18-43b3-a871-d7f8c2f38c3f tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'a14f57dd673f480c9984491a920fcacd', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '0b14dad85f52497c9819f0f3bb397f18', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:25.926917 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-8c0711f0-6c18-43b3-a871-d7f8c2f38c3f tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] 10.222.0.42 "GET /compute/v2.1/servers/6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17" status: 200 len: 1514 microversion: 2.1 time: 0.397735 Sep 16 02:04:25.930668 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [req-0b4ff2d2-3fa1-4103-a3b7-32d504785655 req-f9496a1c-09e2-426c-8391-8cffbfa8dd93 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.089456 Sep 16 02:04:25.931124 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 423/857] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:04:25 2022] GET /compute/v2.1/servers/6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17 => generated 1514 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:04:25.932185 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 435/858] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:04:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 02:04:26.955873 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-e9158f18-1b00-4ae2-b2f7-65906e6a9dd0 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:04:26.956518 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-e9158f18-1b00-4ae2-b2f7-65906e6a9dd0 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] [instance: 6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:04:26.973483 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e9158f18-1b00-4ae2-b2f7-65906e6a9dd0 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:26.973978 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e9158f18-1b00-4ae2-b2f7-65906e6a9dd0 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:26.974411 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e9158f18-1b00-4ae2-b2f7-65906e6a9dd0 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:26.975109 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e9158f18-1b00-4ae2-b2f7-65906e6a9dd0 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:26.975563 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e9158f18-1b00-4ae2-b2f7-65906e6a9dd0 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:26.976001 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e9158f18-1b00-4ae2-b2f7-65906e6a9dd0 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:27.009323 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.wsgi [None req-e9158f18-1b00-4ae2-b2f7-65906e6a9dd0 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] HTTP exception thrown: Instance 6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17 could not be found. Sep 16 02:04:27.013757 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-e9158f18-1b00-4ae2-b2f7-65906e6a9dd0 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Request method failure captured: Sep 16 02:04:27.013757 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: request: GET /compute/v2.1/servers/6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17 HTTP/1.1 Sep 16 02:04:27.013757 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept: application/json Sep 16 02:04:27.013757 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept-Encoding: identity Sep 16 02:04:27.013757 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Connection: close Sep 16 02:04:27.013757 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Length: 0 Sep 16 02:04:27.013757 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Type: application/json Sep 16 02:04:27.013757 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Host: 10.222.0.42 Sep 16 02:04:27.013757 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Openstack-System-Scope: None Sep 16 02:04:27.013757 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: User-Agent: python-urllib3/1.26.12 Sep 16 02:04:27.013757 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Auth-Token: gAAAAABjI9kUSzjDL7dT03Up0jFI__rPLs-SGN9gnWdyx5zL_FcmxTR2j3wa5oZ6fntbpwfWLCR155lUAlZSkuXtdvC6eYk0pjVGCVGer3BCX018vrcqK4w3JeY8heVQhNRbuQufmxTfI3NRfDnU3IxX1Zsy96CC8A4eHO9XiPh_51JEPkVAvSA Sep 16 02:04:27.013757 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Id: None Sep 16 02:04:27.013757 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Name: None Sep 16 02:04:27.013757 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Identity-Status: Confirmed Sep 16 02:04:27.013757 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Is-Admin-Project: True Sep 16 02:04:27.013757 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Id: default Sep 16 02:04:27.013757 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Name: Default Sep 16 02:04:27.013757 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Id: 0b14dad85f52497c9819f0f3bb397f18 Sep 16 02:04:27.013757 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Name: tempest-VolumesSnapshotTestJSON-525688138 Sep 16 02:04:27.013757 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Role: member,reader Sep 16 02:04:27.013757 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Roles: member,reader Sep 16 02:04:27.015368 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/0b14dad85f52497c9819f0f3bb397f18"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0b14dad85f52497c9819f0f3bb397f18"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_0b14dad85f52497c9819f0f3bb397f18"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/0b14dad85f52497c9819f0f3bb397f18"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 02:04:27.015368 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant: tempest-VolumesSnapshotTestJSON-525688138 Sep 16 02:04:27.015368 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Id: 0b14dad85f52497c9819f0f3bb397f18 Sep 16 02:04:27.015368 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-525688138 Sep 16 02:04:27.015368 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User: tempest-VolumesSnapshotTestJSON-525688138-project Sep 16 02:04:27.015368 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Id: default Sep 16 02:04:27.015368 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Name: Default Sep 16 02:04:27.015368 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Id: a14f57dd673f480c9984491a920fcacd Sep 16 02:04:27.015368 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Name: tempest-VolumesSnapshotTestJSON-525688138-project Sep 16 02:04:27.015368 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: method: > Sep 16 02:04:27.015368 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: exception: Instance 6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17 could not be found. Sep 16 02:04:27.015368 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: action_args: {'id': '6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17'} Sep 16 02:04:27.016157 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 02:04:27.016157 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:04:27.016157 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 02:04:27.016157 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 02:04:27.016157 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 02:04:27.016157 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 02:04:27.016157 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 02:04:27.016157 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 02:04:27.016157 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 02:04:27.016157 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 02:04:27.016157 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17 could not be found. Sep 16 02:04:27.016157 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:04:27.016157 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:04:27.016157 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:04:27.016157 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:04:27.016157 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:04:27.016157 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:04:27.016157 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 02:04:27.016157 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 02:04:27.016157 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 02:04:27.017513 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 02:04:27.017513 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 02:04:27.017513 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 02:04:27.017513 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 02:04:27.017513 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 02:04:27.017513 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 02:04:27.017513 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 02:04:27.017513 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17 could not be found. Sep 16 02:04:27.017513 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:04:27.017513 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:04:27.017513 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:04:27.017513 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:04:27.017513 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:04:27.017513 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:04:27.017513 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 02:04:27.017513 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 02:04:27.017513 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17 could not be found. Sep 16 02:04:27.017513 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:04:27.018845 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-e9158f18-1b00-4ae2-b2f7-65906e6a9dd0 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] Returning 404 to user: Instance 6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17 could not be found. {{(pid=120440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 02:04:27.018845 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-e9158f18-1b00-4ae2-b2f7-65906e6a9dd0 tempest-VolumesSnapshotTestJSON-525688138 tempest-VolumesSnapshotTestJSON-525688138-project] 10.222.0.42 "GET /compute/v2.1/servers/6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17" status: 404 len: 111 microversion: 2.1 time: 0.068976 Sep 16 02:04:27.024930 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 424/859] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:04:26 2022] GET /compute/v2.1/servers/6e2fd0c7-ce37-4a35-8c73-f5956f8d7b17 => generated 111 bytes in 77 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 02:04:33.947691 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-8ab78a39-696e-49a8-af86-ee8473494a2c tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Action: 'create', calling method: .version_select at 0x7fae32b48940>, body: {"keypair": {"name": "tempest-keypair-700618004", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBEL2lnmRab1VLsE6D1cgHpQ99xLWN/z6n4FT4v1CgHknA2msYtSkPd+nTxQAEeOomlv9C5nUohfJSC1MRiVe8ssxYYHPFAJZwcTqo5TuvmJ4YZ/oQA9okQK/DAuWY3sI0w=="}} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:04:33.974347 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.quota [None req-8ab78a39-696e-49a8-af86-ee8473494a2c tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Getting quotas for project 663bde66131d47159ffa09ad33971895. Resources: {'key_pairs'} {{(pid=120441) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 02:04:33.978394 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.quota [None req-8ab78a39-696e-49a8-af86-ee8473494a2c tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Getting quotas for user 86bc1b5163f4453db4469fef90f27344 and project 663bde66131d47159ffa09ad33971895. Resources: {'key_pairs'} {{(pid=120441) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 02:04:34.001576 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-8ab78a39-696e-49a8-af86-ee8473494a2c tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.341477 Sep 16 02:04:34.002165 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 436/860] 10.222.0.42 () {60 vars in 1159 bytes} [Fri Sep 16 02:04:33 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:04:35.690810 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-01804101-4ea9-49e4-9063-6cdae5502173 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-57014086", "imageRef": "1546da04-912c-44c6-b4b9-34fba35e08f6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "80b93367-5ee2-4183-922b-cb2be17dc7b7"}], "security_groups": [{"name": "tempest-securitygroup--265722855"}], "key_name": "tempest-keypair-700618004", "user_data": "}} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:04:35.841181 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.network.neutron [None req-01804101-4ea9-49e4-9063-6cdae5502173 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] validate_networks() for [('80b93367-5ee2-4183-922b-cb2be17dc7b7', None, None, None, None, None)] {{(pid=120440) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 02:04:36.437701 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.virt.hardware [None req-01804101-4ea9-49e4-9063-6cdae5502173 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Flavor limits 0:0:0 {{(pid=120440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 02:04:36.438386 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.virt.hardware [None req-01804101-4ea9-49e4-9063-6cdae5502173 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Image limits 0:0:0 {{(pid=120440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 02:04:36.439237 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.virt.hardware [None req-01804101-4ea9-49e4-9063-6cdae5502173 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Flavor pref 0:0:0 {{(pid=120440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 02:04:36.440449 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.virt.hardware [None req-01804101-4ea9-49e4-9063-6cdae5502173 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Image pref 0:0:0 {{(pid=120440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 02:04:36.441126 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.virt.hardware [None req-01804101-4ea9-49e4-9063-6cdae5502173 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 02:04:36.452535 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-01804101-4ea9-49e4-9063-6cdae5502173 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:36.453298 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-01804101-4ea9-49e4-9063-6cdae5502173 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:36.453897 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-01804101-4ea9-49e4-9063-6cdae5502173 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:36.454795 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-01804101-4ea9-49e4-9063-6cdae5502173 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:36.455620 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-01804101-4ea9-49e4-9063-6cdae5502173 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:36.456400 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-01804101-4ea9-49e4-9063-6cdae5502173 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:36.495196 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.quota [None req-01804101-4ea9-49e4-9063-6cdae5502173 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Getting quotas for project 663bde66131d47159ffa09ad33971895. Resources: {'cores', 'ram', 'instances'} {{(pid=120440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 02:04:36.502314 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.quota [None req-01804101-4ea9-49e4-9063-6cdae5502173 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Getting quotas for user 86bc1b5163f4453db4469fef90f27344 and project 663bde66131d47159ffa09ad33971895. Resources: {'cores', 'ram', 'instances'} {{(pid=120440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 02:04:36.531762 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-01804101-4ea9-49e4-9063-6cdae5502173 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Going to run 1 instances... {{(pid=120440) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 02:04:36.536381 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-01804101-4ea9-49e4-9063-6cdae5502173 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: edc72a68-5643-42ab-8bed-d8a70c4aaeef] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1546da04-912c-44c6-b4b9-34fba35e08f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 02:04:36.621735 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR oslo.messaging._drivers.impl_rabbit [None req-01804101-4ea9-49e4-9063-6cdae5502173 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [65a34517-5366-4b90-9842-3248277b5f26] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 16 02:04:37.631338 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO oslo.messaging._drivers.impl_rabbit [None req-01804101-4ea9-49e4-9063-6cdae5502173 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [65a34517-5366-4b90-9842-3248277b5f26] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 37548. Sep 16 02:04:37.646103 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-01804101-4ea9-49e4-9063-6cdae5502173 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.961309 Sep 16 02:04:37.647134 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 425/861] 10.222.0.42 () {60 vars in 1147 bytes} [Fri Sep 16 02:04:35 2022] POST /compute/v2.1/servers => generated 401 bytes in 1963 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 02:04:37.657085 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell1:SELECT=31,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:04:37.662069 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-a7f3f3d1-2599-4595-8e4e-69008b6dffa9 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:04:37.663057 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-a7f3f3d1-2599-4595-8e4e-69008b6dffa9 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: edc72a68-5643-42ab-8bed-d8a70c4aaeef] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:04:37.787698 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-a7f3f3d1-2599-4595-8e4e-69008b6dffa9 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:37.806006 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-a7f3f3d1-2599-4595-8e4e-69008b6dffa9 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef" status: 200 len: 1239 microversion: 2.1 time: 0.151589 Sep 16 02:04:37.806648 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 437/862] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:04:37 2022] GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef => generated 1239 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:04:37.972740 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-11f1f16f-903f-4c13-a95b-c91489504b0a tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Action: 'create', calling method: .version_select at 0x7fae3630bb80>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-993447048", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMEtq9vCNewrLRsqtwF4pqpIudleamYOeG/7O9M/laUuKlVRHZyyHaak3tUQX0ugnjuD3zfnOG+VGZse9p2P68NAHVeqqh/J40wdUwJEU3vkXPFRtv6TFuzRWGdcs82h2g=="}} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:04:38.014269 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.quota [None req-11f1f16f-903f-4c13-a95b-c91489504b0a tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Getting quotas for project 5318d2681e9d4fd2adc29977165e0a9b. Resources: {'key_pairs'} {{(pid=120440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 02:04:38.019216 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.quota [None req-11f1f16f-903f-4c13-a95b-c91489504b0a tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Getting quotas for user e961b9e63ece47e8934b7e4c7b5c46ff and project 5318d2681e9d4fd2adc29977165e0a9b. Resources: {'key_pairs'} {{(pid=120440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 02:04:38.048454 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-11f1f16f-903f-4c13-a95b-c91489504b0a tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.085951 Sep 16 02:04:38.049326 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 426/863] 10.222.0.42 () {60 vars in 1159 bytes} [Fri Sep 16 02:04:37 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:04:38.272838 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-75162f30-5bcd-4c1a-bb73-83b855e06320 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1562339510", "imageRef": "2484fa58-6f8a-4bcc-ab49-bf50958baae9", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-993447048", "networks": [{"uuid": "6cd1d01a-1fcb-42e8-9408-458ee0e372f2"}]}} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:04:38.338290 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.network.neutron [None req-75162f30-5bcd-4c1a-bb73-83b855e06320 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] validate_networks() for [('6cd1d01a-1fcb-42e8-9408-458ee0e372f2', None, None, None, None, None)] {{(pid=120441) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 02:04:38.745711 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.virt.hardware [None req-75162f30-5bcd-4c1a-bb73-83b855e06320 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Flavor limits 0:0:0 {{(pid=120441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 02:04:38.746245 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.virt.hardware [None req-75162f30-5bcd-4c1a-bb73-83b855e06320 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Image limits 0:0:0 {{(pid=120441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 02:04:38.746496 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.virt.hardware [None req-75162f30-5bcd-4c1a-bb73-83b855e06320 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Flavor pref 0:0:0 {{(pid=120441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 02:04:38.746932 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.virt.hardware [None req-75162f30-5bcd-4c1a-bb73-83b855e06320 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Image pref 0:0:0 {{(pid=120441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 02:04:38.747332 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.virt.hardware [None req-75162f30-5bcd-4c1a-bb73-83b855e06320 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 02:04:38.757598 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-75162f30-5bcd-4c1a-bb73-83b855e06320 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:38.758075 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-75162f30-5bcd-4c1a-bb73-83b855e06320 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:38.758511 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-75162f30-5bcd-4c1a-bb73-83b855e06320 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:38.759245 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-75162f30-5bcd-4c1a-bb73-83b855e06320 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:38.759707 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-75162f30-5bcd-4c1a-bb73-83b855e06320 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:38.760283 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-75162f30-5bcd-4c1a-bb73-83b855e06320 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:38.777214 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.quota [None req-75162f30-5bcd-4c1a-bb73-83b855e06320 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Getting quotas for project 5318d2681e9d4fd2adc29977165e0a9b. Resources: {'cores', 'ram', 'instances'} {{(pid=120441) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 02:04:38.782077 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.quota [None req-75162f30-5bcd-4c1a-bb73-83b855e06320 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Getting quotas for user e961b9e63ece47e8934b7e4c7b5c46ff and project 5318d2681e9d4fd2adc29977165e0a9b. Resources: {'cores', 'ram', 'instances'} {{(pid=120441) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 02:04:38.793228 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-75162f30-5bcd-4c1a-bb73-83b855e06320 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Going to run 1 instances... {{(pid=120441) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 02:04:38.796263 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-75162f30-5bcd-4c1a-bb73-83b855e06320 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] [instance: 8351c196-00ce-4ff2-8c6d-b2464bfcf401] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='2484fa58-6f8a-4bcc-ab49-bf50958baae9',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120441) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 02:04:38.832865 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-5a25cd73-e8b3-4df9-afa9-673a73c45bb0 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:04:38.834043 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-5a25cd73-e8b3-4df9-afa9-673a73c45bb0 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: edc72a68-5643-42ab-8bed-d8a70c4aaeef] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:04:38.840471 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-5a25cd73-e8b3-4df9-afa9-673a73c45bb0 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:38.841275 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-5a25cd73-e8b3-4df9-afa9-673a73c45bb0 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:38.842396 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-5a25cd73-e8b3-4df9-afa9-673a73c45bb0 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:38.843252 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-5a25cd73-e8b3-4df9-afa9-673a73c45bb0 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:38.843751 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-5a25cd73-e8b3-4df9-afa9-673a73c45bb0 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:38.844303 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-5a25cd73-e8b3-4df9-afa9-673a73c45bb0 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:38.852484 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-75162f30-5bcd-4c1a-bb73-83b855e06320 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.581303 Sep 16 02:04:38.853537 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 438/864] 10.222.0.42 () {60 vars in 1147 bytes} [Fri Sep 16 02:04:38 2022] POST /compute/v2.1/servers => generated 380 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 16 02:04:38.866761 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-c43fa1f2-029f-430d-a9ef-1e6089b1167b tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:04:38.867647 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-c43fa1f2-029f-430d-a9ef-1e6089b1167b tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] [instance: 8351c196-00ce-4ff2-8c6d-b2464bfcf401] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:04:38.946706 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-5a25cd73-e8b3-4df9-afa9-673a73c45bb0 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:38.949374 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-c43fa1f2-029f-430d-a9ef-1e6089b1167b tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961b9e63ece47e8934b7e4c7b5c46ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5318d2681e9d4fd2adc29977165e0a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:38.954733 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-5a25cd73-e8b3-4df9-afa9-673a73c45bb0 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef" status: 200 len: 1243 microversion: 2.1 time: 0.126476 Sep 16 02:04:38.955311 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 427/865] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:04:38 2022] GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef => generated 1243 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:04:38.970838 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-c43fa1f2-029f-430d-a9ef-1e6089b1167b tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] 10.222.0.42 "GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401" status: 200 len: 1258 microversion: 2.1 time: 0.109357 Sep 16 02:04:38.971429 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 439/866] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:04:38 2022] GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401 => generated 1258 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:04:39.978854 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-78d51fd1-d75b-4dfc-8b33-e48f98f69f70 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:04:39.979462 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-78d51fd1-d75b-4dfc-8b33-e48f98f69f70 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: edc72a68-5643-42ab-8bed-d8a70c4aaeef] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:04:39.988912 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-78d51fd1-d75b-4dfc-8b33-e48f98f69f70 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:39.989410 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-78d51fd1-d75b-4dfc-8b33-e48f98f69f70 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:39.989887 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-78d51fd1-d75b-4dfc-8b33-e48f98f69f70 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:39.990594 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-78d51fd1-d75b-4dfc-8b33-e48f98f69f70 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:39.991049 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-78d51fd1-d75b-4dfc-8b33-e48f98f69f70 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:39.991470 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-78d51fd1-d75b-4dfc-8b33-e48f98f69f70 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:39.993256 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-18a1da85-c883-49a9-84ec-bbd3538ff58c tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:04:39.993924 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-18a1da85-c883-49a9-84ec-bbd3538ff58c tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] [instance: 8351c196-00ce-4ff2-8c6d-b2464bfcf401] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:04:40.002594 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-18a1da85-c883-49a9-84ec-bbd3538ff58c tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:40.003158 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-18a1da85-c883-49a9-84ec-bbd3538ff58c tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:40.003659 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-18a1da85-c883-49a9-84ec-bbd3538ff58c tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:40.004437 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-18a1da85-c883-49a9-84ec-bbd3538ff58c tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:40.005067 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-18a1da85-c883-49a9-84ec-bbd3538ff58c tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:40.005480 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-18a1da85-c883-49a9-84ec-bbd3538ff58c tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:40.066583 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-78d51fd1-d75b-4dfc-8b33-e48f98f69f70 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:40.070499 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-18a1da85-c883-49a9-84ec-bbd3538ff58c tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961b9e63ece47e8934b7e4c7b5c46ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5318d2681e9d4fd2adc29977165e0a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:40.074583 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-78d51fd1-d75b-4dfc-8b33-e48f98f69f70 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef" status: 200 len: 1243 microversion: 2.1 time: 0.099778 Sep 16 02:04:40.075537 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 428/867] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:04:39 2022] GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef => generated 1243 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:04:40.082314 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-18a1da85-c883-49a9-84ec-bbd3538ff58c tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] 10.222.0.42 "GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401" status: 200 len: 1262 microversion: 2.1 time: 0.093310 Sep 16 02:04:40.082889 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 440/868] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:04:39 2022] GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401 => generated 1262 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 02:04:41.098089 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-28f869d7-b044-4edf-943a-7e91cf7df1ce tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:04:41.098710 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-28f869d7-b044-4edf-943a-7e91cf7df1ce tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: edc72a68-5643-42ab-8bed-d8a70c4aaeef] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:04:41.104189 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-91366c3d-8a8e-47bd-8283-1e6dc4eb4823 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:04:41.104799 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-91366c3d-8a8e-47bd-8283-1e6dc4eb4823 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] [instance: 8351c196-00ce-4ff2-8c6d-b2464bfcf401] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:04:41.105308 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-28f869d7-b044-4edf-943a-7e91cf7df1ce tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:41.105794 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-28f869d7-b044-4edf-943a-7e91cf7df1ce tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:41.106294 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-28f869d7-b044-4edf-943a-7e91cf7df1ce tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:41.106951 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-28f869d7-b044-4edf-943a-7e91cf7df1ce tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:41.108054 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-28f869d7-b044-4edf-943a-7e91cf7df1ce tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:41.108483 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-28f869d7-b044-4edf-943a-7e91cf7df1ce tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:41.112299 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-91366c3d-8a8e-47bd-8283-1e6dc4eb4823 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:41.112788 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-91366c3d-8a8e-47bd-8283-1e6dc4eb4823 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:41.113211 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-91366c3d-8a8e-47bd-8283-1e6dc4eb4823 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:41.113891 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-91366c3d-8a8e-47bd-8283-1e6dc4eb4823 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:41.114339 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-91366c3d-8a8e-47bd-8283-1e6dc4eb4823 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:41.114760 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-91366c3d-8a8e-47bd-8283-1e6dc4eb4823 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:41.173538 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-28f869d7-b044-4edf-943a-7e91cf7df1ce tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:41.177776 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-91366c3d-8a8e-47bd-8283-1e6dc4eb4823 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961b9e63ece47e8934b7e4c7b5c46ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5318d2681e9d4fd2adc29977165e0a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:41.181267 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-28f869d7-b044-4edf-943a-7e91cf7df1ce tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef" status: 200 len: 1243 microversion: 2.1 time: 0.087108 Sep 16 02:04:41.181832 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 429/869] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:04:41 2022] GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef => generated 1243 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:04:41.185627 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-91366c3d-8a8e-47bd-8283-1e6dc4eb4823 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] 10.222.0.42 "GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401" status: 200 len: 1262 microversion: 2.1 time: 0.085214 Sep 16 02:04:41.186259 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 441/870] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:04:41 2022] GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401 => generated 1262 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 02:04:42.204315 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-61b945b0-ef21-4644-8a36-df8a079cf041 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:04:42.205028 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-61b945b0-ef21-4644-8a36-df8a079cf041 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: edc72a68-5643-42ab-8bed-d8a70c4aaeef] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:04:42.209286 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-fc05b44d-e85f-4810-8a10-eb4d92bfe27d tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:04:42.209944 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-fc05b44d-e85f-4810-8a10-eb4d92bfe27d tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] [instance: 8351c196-00ce-4ff2-8c6d-b2464bfcf401] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:04:42.211637 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-61b945b0-ef21-4644-8a36-df8a079cf041 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:42.212396 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-61b945b0-ef21-4644-8a36-df8a079cf041 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:42.213077 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-61b945b0-ef21-4644-8a36-df8a079cf041 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:42.213986 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-61b945b0-ef21-4644-8a36-df8a079cf041 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:42.214634 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-61b945b0-ef21-4644-8a36-df8a079cf041 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:42.215252 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-61b945b0-ef21-4644-8a36-df8a079cf041 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:42.215651 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_api:SELECT=58,nova_api:DELETE=1,nova_api:UPDATE=1,nova_api:INSERT=4 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:04:42.217349 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fc05b44d-e85f-4810-8a10-eb4d92bfe27d tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:42.218051 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fc05b44d-e85f-4810-8a10-eb4d92bfe27d tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:42.218488 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fc05b44d-e85f-4810-8a10-eb4d92bfe27d tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:42.219188 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fc05b44d-e85f-4810-8a10-eb4d92bfe27d tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:42.219635 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fc05b44d-e85f-4810-8a10-eb4d92bfe27d tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:42.220355 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fc05b44d-e85f-4810-8a10-eb4d92bfe27d tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:42.287576 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-fc05b44d-e85f-4810-8a10-eb4d92bfe27d tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961b9e63ece47e8934b7e4c7b5c46ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5318d2681e9d4fd2adc29977165e0a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:42.289005 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-61b945b0-ef21-4644-8a36-df8a079cf041 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:42.296712 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-fc05b44d-e85f-4810-8a10-eb4d92bfe27d tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] 10.222.0.42 "GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401" status: 200 len: 1254 microversion: 2.1 time: 0.093149 Sep 16 02:04:42.297276 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 442/871] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:04:42 2022] GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401 => generated 1254 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 02:04:42.298857 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-61b945b0-ef21-4644-8a36-df8a079cf041 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef" status: 200 len: 1235 microversion: 2.1 time: 0.098542 Sep 16 02:04:42.299419 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 430/872] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:04:42 2022] GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef => generated 1235 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:04:43.320034 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-194f7610-24d9-481e-a4ad-3486b81bbb70 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:04:43.321615 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-194f7610-24d9-481e-a4ad-3486b81bbb70 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] [instance: 8351c196-00ce-4ff2-8c6d-b2464bfcf401] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:04:43.325633 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-78635e3d-d00e-40a4-b66d-9deea7b44825 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:04:43.326257 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-78635e3d-d00e-40a4-b66d-9deea7b44825 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: edc72a68-5643-42ab-8bed-d8a70c4aaeef] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:04:43.329500 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_api:SELECT=48,nova_api:INSERT=4 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:04:43.334082 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-194f7610-24d9-481e-a4ad-3486b81bbb70 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:43.335147 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-194f7610-24d9-481e-a4ad-3486b81bbb70 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:43.335267 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-78635e3d-d00e-40a4-b66d-9deea7b44825 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:43.335732 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-78635e3d-d00e-40a4-b66d-9deea7b44825 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:43.336207 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-78635e3d-d00e-40a4-b66d-9deea7b44825 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:43.337173 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-194f7610-24d9-481e-a4ad-3486b81bbb70 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:43.337832 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-194f7610-24d9-481e-a4ad-3486b81bbb70 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:43.338521 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-194f7610-24d9-481e-a4ad-3486b81bbb70 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:43.338720 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-78635e3d-d00e-40a4-b66d-9deea7b44825 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:43.339330 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-194f7610-24d9-481e-a4ad-3486b81bbb70 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:43.340913 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-78635e3d-d00e-40a4-b66d-9deea7b44825 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:43.341617 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-78635e3d-d00e-40a4-b66d-9deea7b44825 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:43.370557 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell1:SELECT=57,nova_cell1:INSERT=1 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:04:43.417925 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-194f7610-24d9-481e-a4ad-3486b81bbb70 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961b9e63ece47e8934b7e4c7b5c46ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5318d2681e9d4fd2adc29977165e0a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:43.418124 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-78635e3d-d00e-40a4-b66d-9deea7b44825 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:43.427566 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-194f7610-24d9-481e-a4ad-3486b81bbb70 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] 10.222.0.42 "GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401" status: 200 len: 1310 microversion: 2.1 time: 0.111675 Sep 16 02:04:43.429254 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-78635e3d-d00e-40a4-b66d-9deea7b44825 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef" status: 200 len: 1297 microversion: 2.1 time: 0.110332 Sep 16 02:04:43.429876 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 431/873] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:04:43 2022] GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef => generated 1297 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:04:43.432623 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 443/874] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:04:43 2022] GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401 => generated 1310 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:04:44.456548 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-4822c8f8-6644-4f9f-b804-c40ba7642bc1 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:04:44.457225 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-4822c8f8-6644-4f9f-b804-c40ba7642bc1 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: edc72a68-5643-42ab-8bed-d8a70c4aaeef] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:04:44.457967 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-11f9f830-3f70-4064-ae19-f8b6feab0c6c tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:04:44.466550 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-11f9f830-3f70-4064-ae19-f8b6feab0c6c tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] [instance: 8351c196-00ce-4ff2-8c6d-b2464bfcf401] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:04:44.467005 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4822c8f8-6644-4f9f-b804-c40ba7642bc1 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:44.468135 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4822c8f8-6644-4f9f-b804-c40ba7642bc1 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:44.472240 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4822c8f8-6644-4f9f-b804-c40ba7642bc1 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:44.473030 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4822c8f8-6644-4f9f-b804-c40ba7642bc1 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:44.475906 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4822c8f8-6644-4f9f-b804-c40ba7642bc1 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:44.476393 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4822c8f8-6644-4f9f-b804-c40ba7642bc1 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:44.477211 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-11f9f830-3f70-4064-ae19-f8b6feab0c6c tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:44.477936 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-11f9f830-3f70-4064-ae19-f8b6feab0c6c tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:44.478601 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-11f9f830-3f70-4064-ae19-f8b6feab0c6c tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:44.479675 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-11f9f830-3f70-4064-ae19-f8b6feab0c6c tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:44.480390 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-11f9f830-3f70-4064-ae19-f8b6feab0c6c tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:44.481036 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-11f9f830-3f70-4064-ae19-f8b6feab0c6c tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:44.558576 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-11f9f830-3f70-4064-ae19-f8b6feab0c6c tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961b9e63ece47e8934b7e4c7b5c46ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5318d2681e9d4fd2adc29977165e0a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:44.573691 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-11f9f830-3f70-4064-ae19-f8b6feab0c6c tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] 10.222.0.42 "GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401" status: 200 len: 1316 microversion: 2.1 time: 0.126203 Sep 16 02:04:44.575192 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 432/875] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:04:44 2022] GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401 => generated 1316 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 02:04:44.885918 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-4822c8f8-6644-4f9f-b804-c40ba7642bc1 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:44.896246 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-4822c8f8-6644-4f9f-b804-c40ba7642bc1 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef" status: 200 len: 1364 microversion: 2.1 time: 0.445945 Sep 16 02:04:44.909316 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 444/876] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:04:44 2022] GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef => generated 1364 bytes in 459 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:04:45.598917 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-af855556-5b11-4c31-b9b7-233ff7a857ce tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:04:45.599647 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-af855556-5b11-4c31-b9b7-233ff7a857ce tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] [instance: 8351c196-00ce-4ff2-8c6d-b2464bfcf401] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:04:45.606306 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-af855556-5b11-4c31-b9b7-233ff7a857ce tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:45.606782 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-af855556-5b11-4c31-b9b7-233ff7a857ce tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:45.607214 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-af855556-5b11-4c31-b9b7-233ff7a857ce tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:45.607970 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-af855556-5b11-4c31-b9b7-233ff7a857ce tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:45.608745 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-af855556-5b11-4c31-b9b7-233ff7a857ce tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:45.609172 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-af855556-5b11-4c31-b9b7-233ff7a857ce tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:45.747449 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-af855556-5b11-4c31-b9b7-233ff7a857ce tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961b9e63ece47e8934b7e4c7b5c46ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5318d2681e9d4fd2adc29977165e0a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:45.757755 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-af855556-5b11-4c31-b9b7-233ff7a857ce tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] 10.222.0.42 "GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401" status: 200 len: 1358 microversion: 2.1 time: 0.162676 Sep 16 02:04:45.758504 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 433/877] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:04:45 2022] GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:04:45.922977 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-fd1590c1-f4c9-4a62-8fa0-9fb1089cfb17 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:04:45.923661 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-fd1590c1-f4c9-4a62-8fa0-9fb1089cfb17 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: edc72a68-5643-42ab-8bed-d8a70c4aaeef] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:04:45.929837 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fd1590c1-f4c9-4a62-8fa0-9fb1089cfb17 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:45.930313 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fd1590c1-f4c9-4a62-8fa0-9fb1089cfb17 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:45.930742 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fd1590c1-f4c9-4a62-8fa0-9fb1089cfb17 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:45.931417 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fd1590c1-f4c9-4a62-8fa0-9fb1089cfb17 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:45.931867 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fd1590c1-f4c9-4a62-8fa0-9fb1089cfb17 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:45.932411 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fd1590c1-f4c9-4a62-8fa0-9fb1089cfb17 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:46.104011 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-fd1590c1-f4c9-4a62-8fa0-9fb1089cfb17 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:46.113142 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-fd1590c1-f4c9-4a62-8fa0-9fb1089cfb17 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef" status: 200 len: 1364 microversion: 2.1 time: 0.194994 Sep 16 02:04:46.113726 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 445/878] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:04:45 2022] GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef => generated 1364 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:04:46.781294 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-0baaa71c-5c7f-4568-ba01-5456d7ae5c8a tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:04:46.781905 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-0baaa71c-5c7f-4568-ba01-5456d7ae5c8a tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] [instance: 8351c196-00ce-4ff2-8c6d-b2464bfcf401] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:04:46.783706 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell0:SELECT=2 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:04:46.790024 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0baaa71c-5c7f-4568-ba01-5456d7ae5c8a tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:46.792353 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0baaa71c-5c7f-4568-ba01-5456d7ae5c8a tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:46.792806 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0baaa71c-5c7f-4568-ba01-5456d7ae5c8a tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:46.793564 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0baaa71c-5c7f-4568-ba01-5456d7ae5c8a tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:46.796077 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0baaa71c-5c7f-4568-ba01-5456d7ae5c8a tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:46.796077 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0baaa71c-5c7f-4568-ba01-5456d7ae5c8a tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:46.954627 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-0baaa71c-5c7f-4568-ba01-5456d7ae5c8a tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961b9e63ece47e8934b7e4c7b5c46ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5318d2681e9d4fd2adc29977165e0a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:46.962450 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-0baaa71c-5c7f-4568-ba01-5456d7ae5c8a tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] 10.222.0.42 "GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401" status: 200 len: 1358 microversion: 2.1 time: 0.185630 Sep 16 02:04:46.963006 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 434/879] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:04:46 2022] GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401 => generated 1358 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:04:47.136697 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-275598b4-75f7-4431-a1e8-2b442d21354d tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:04:47.138032 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-275598b4-75f7-4431-a1e8-2b442d21354d tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: edc72a68-5643-42ab-8bed-d8a70c4aaeef] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:04:47.145932 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-275598b4-75f7-4431-a1e8-2b442d21354d tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:47.146906 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-275598b4-75f7-4431-a1e8-2b442d21354d tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:47.147565 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-275598b4-75f7-4431-a1e8-2b442d21354d tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:47.148533 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-275598b4-75f7-4431-a1e8-2b442d21354d tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:47.149042 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-275598b4-75f7-4431-a1e8-2b442d21354d tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:47.149523 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-275598b4-75f7-4431-a1e8-2b442d21354d tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:47.328053 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-275598b4-75f7-4431-a1e8-2b442d21354d tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:47.338052 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-275598b4-75f7-4431-a1e8-2b442d21354d tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef" status: 200 len: 1364 microversion: 2.1 time: 0.205328 Sep 16 02:04:47.351278 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 446/880] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:04:47 2022] GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef => generated 1364 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:04:47.987193 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-e6f924d4-12d7-414f-881d-dc110a44dd59 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:04:47.988533 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-e6f924d4-12d7-414f-881d-dc110a44dd59 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] [instance: 8351c196-00ce-4ff2-8c6d-b2464bfcf401] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:04:47.996062 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e6f924d4-12d7-414f-881d-dc110a44dd59 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:47.996886 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e6f924d4-12d7-414f-881d-dc110a44dd59 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:47.997772 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e6f924d4-12d7-414f-881d-dc110a44dd59 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:47.998850 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e6f924d4-12d7-414f-881d-dc110a44dd59 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:47.999539 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e6f924d4-12d7-414f-881d-dc110a44dd59 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:48.000534 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e6f924d4-12d7-414f-881d-dc110a44dd59 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:48.033715 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell0:SELECT=10 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:04:48.138556 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-e6f924d4-12d7-414f-881d-dc110a44dd59 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961b9e63ece47e8934b7e4c7b5c46ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5318d2681e9d4fd2adc29977165e0a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:48.147306 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-e6f924d4-12d7-414f-881d-dc110a44dd59 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] 10.222.0.42 "GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401" status: 200 len: 1358 microversion: 2.1 time: 0.164471 Sep 16 02:04:48.147883 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 435/881] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:04:47 2022] GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401 => generated 1358 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:04:48.363762 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-8fc54f70-9196-40b1-a105-ced4c60b2f44 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:04:48.364507 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-8fc54f70-9196-40b1-a105-ced4c60b2f44 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: edc72a68-5643-42ab-8bed-d8a70c4aaeef] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:04:48.376442 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8fc54f70-9196-40b1-a105-ced4c60b2f44 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:48.376926 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8fc54f70-9196-40b1-a105-ced4c60b2f44 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:48.377356 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8fc54f70-9196-40b1-a105-ced4c60b2f44 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:48.378046 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8fc54f70-9196-40b1-a105-ced4c60b2f44 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:48.378632 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8fc54f70-9196-40b1-a105-ced4c60b2f44 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:48.379375 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8fc54f70-9196-40b1-a105-ced4c60b2f44 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:48.578770 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-8fc54f70-9196-40b1-a105-ced4c60b2f44 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:48.591088 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-8fc54f70-9196-40b1-a105-ced4c60b2f44 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef" status: 200 len: 1364 microversion: 2.1 time: 0.231691 Sep 16 02:04:48.592006 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 447/882] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:04:48 2022] GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef => generated 1364 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:04:49.172267 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-14b40288-799a-408a-b28d-252088966904 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:04:49.173151 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-14b40288-799a-408a-b28d-252088966904 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] [instance: 8351c196-00ce-4ff2-8c6d-b2464bfcf401] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:04:49.179124 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-14b40288-799a-408a-b28d-252088966904 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:49.179623 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-14b40288-799a-408a-b28d-252088966904 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:49.180109 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-14b40288-799a-408a-b28d-252088966904 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:49.180800 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-14b40288-799a-408a-b28d-252088966904 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:49.181253 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-14b40288-799a-408a-b28d-252088966904 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:49.181679 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-14b40288-799a-408a-b28d-252088966904 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:49.334641 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-14b40288-799a-408a-b28d-252088966904 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961b9e63ece47e8934b7e4c7b5c46ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5318d2681e9d4fd2adc29977165e0a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:49.349872 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-14b40288-799a-408a-b28d-252088966904 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] 10.222.0.42 "GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401" status: 200 len: 1358 microversion: 2.1 time: 0.182561 Sep 16 02:04:49.351454 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 436/883] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:04:49 2022] GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401 => generated 1358 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:04:49.614836 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-6fdee426-55e9-4971-9a5e-f17175c958ec tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:04:49.615456 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-6fdee426-55e9-4971-9a5e-f17175c958ec tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: edc72a68-5643-42ab-8bed-d8a70c4aaeef] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:04:49.617279 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell0:SELECT=2 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:04:49.618032 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell0:SELECT=14 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:04:49.628358 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-6fdee426-55e9-4971-9a5e-f17175c958ec tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:49.628948 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-6fdee426-55e9-4971-9a5e-f17175c958ec tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:49.629276 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-6fdee426-55e9-4971-9a5e-f17175c958ec tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:49.629973 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-6fdee426-55e9-4971-9a5e-f17175c958ec tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:49.630423 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-6fdee426-55e9-4971-9a5e-f17175c958ec tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:49.630840 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-6fdee426-55e9-4971-9a5e-f17175c958ec tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:49.816232 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-6fdee426-55e9-4971-9a5e-f17175c958ec tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:49.824216 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-6fdee426-55e9-4971-9a5e-f17175c958ec tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef" status: 200 len: 1364 microversion: 2.1 time: 0.213327 Sep 16 02:04:49.839980 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 448/884] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:04:49 2022] GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef => generated 1364 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:04:50.375396 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-1c1dfe83-f85d-4d97-98a4-88a109a84424 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:04:50.376031 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-1c1dfe83-f85d-4d97-98a4-88a109a84424 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] [instance: 8351c196-00ce-4ff2-8c6d-b2464bfcf401] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:04:50.383846 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1c1dfe83-f85d-4d97-98a4-88a109a84424 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:50.384793 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1c1dfe83-f85d-4d97-98a4-88a109a84424 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:50.385592 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1c1dfe83-f85d-4d97-98a4-88a109a84424 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:50.386859 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1c1dfe83-f85d-4d97-98a4-88a109a84424 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:50.388103 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1c1dfe83-f85d-4d97-98a4-88a109a84424 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:50.389688 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1c1dfe83-f85d-4d97-98a4-88a109a84424 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:50.532671 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-1c1dfe83-f85d-4d97-98a4-88a109a84424 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961b9e63ece47e8934b7e4c7b5c46ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5318d2681e9d4fd2adc29977165e0a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:50.543520 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-1c1dfe83-f85d-4d97-98a4-88a109a84424 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] 10.222.0.42 "GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401" status: 200 len: 1358 microversion: 2.1 time: 0.173374 Sep 16 02:04:50.544124 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 437/885] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:04:50 2022] GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401 => generated 1358 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:04:50.849956 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-8028ed85-fed0-4cb6-89e3-91aa19f65521 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:04:50.849956 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-8028ed85-fed0-4cb6-89e3-91aa19f65521 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: edc72a68-5643-42ab-8bed-d8a70c4aaeef] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:04:50.855779 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8028ed85-fed0-4cb6-89e3-91aa19f65521 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:50.856308 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8028ed85-fed0-4cb6-89e3-91aa19f65521 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:50.856748 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8028ed85-fed0-4cb6-89e3-91aa19f65521 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:50.857495 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8028ed85-fed0-4cb6-89e3-91aa19f65521 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:50.858248 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8028ed85-fed0-4cb6-89e3-91aa19f65521 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:50.858685 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8028ed85-fed0-4cb6-89e3-91aa19f65521 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:51.051985 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-8028ed85-fed0-4cb6-89e3-91aa19f65521 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:51.062851 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-8028ed85-fed0-4cb6-89e3-91aa19f65521 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef" status: 200 len: 1364 microversion: 2.1 time: 0.216567 Sep 16 02:04:51.065351 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 449/886] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:04:50 2022] GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef => generated 1364 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:04:51.570150 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-d51188c8-7983-400c-942b-77e0a7852b27 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:04:51.570804 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-d51188c8-7983-400c-942b-77e0a7852b27 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] [instance: 8351c196-00ce-4ff2-8c6d-b2464bfcf401] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:04:51.577439 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d51188c8-7983-400c-942b-77e0a7852b27 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:51.577926 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d51188c8-7983-400c-942b-77e0a7852b27 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:51.578476 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d51188c8-7983-400c-942b-77e0a7852b27 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:51.579334 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d51188c8-7983-400c-942b-77e0a7852b27 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:51.579792 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d51188c8-7983-400c-942b-77e0a7852b27 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:51.580245 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d51188c8-7983-400c-942b-77e0a7852b27 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:51.725353 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-d51188c8-7983-400c-942b-77e0a7852b27 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961b9e63ece47e8934b7e4c7b5c46ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5318d2681e9d4fd2adc29977165e0a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:51.734618 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-d51188c8-7983-400c-942b-77e0a7852b27 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] 10.222.0.42 "GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401" status: 200 len: 1358 microversion: 2.1 time: 0.171274 Sep 16 02:04:51.735196 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 438/887] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:04:51 2022] GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 02:04:52.088584 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-4a3a480e-84e3-4f7c-8aec-ece41271ba92 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:04:52.089266 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-4a3a480e-84e3-4f7c-8aec-ece41271ba92 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: edc72a68-5643-42ab-8bed-d8a70c4aaeef] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:04:52.095829 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4a3a480e-84e3-4f7c-8aec-ece41271ba92 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:52.096332 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4a3a480e-84e3-4f7c-8aec-ece41271ba92 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:52.096761 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4a3a480e-84e3-4f7c-8aec-ece41271ba92 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:52.097435 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4a3a480e-84e3-4f7c-8aec-ece41271ba92 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:52.097881 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4a3a480e-84e3-4f7c-8aec-ece41271ba92 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:52.098385 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4a3a480e-84e3-4f7c-8aec-ece41271ba92 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:52.243086 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-4a3a480e-84e3-4f7c-8aec-ece41271ba92 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:52.247359 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-4a3a480e-84e3-4f7c-8aec-ece41271ba92 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef" status: 200 len: 1364 microversion: 2.1 time: 0.162612 Sep 16 02:04:52.247909 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 450/888] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:04:52 2022] GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef => generated 1364 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:04:52.758537 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-0d1abd11-36fe-486e-9408-25696ec0c1e8 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:04:52.759128 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-0d1abd11-36fe-486e-9408-25696ec0c1e8 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] [instance: 8351c196-00ce-4ff2-8c6d-b2464bfcf401] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:04:52.765315 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0d1abd11-36fe-486e-9408-25696ec0c1e8 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:52.765936 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0d1abd11-36fe-486e-9408-25696ec0c1e8 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:52.766368 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0d1abd11-36fe-486e-9408-25696ec0c1e8 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:52.767045 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0d1abd11-36fe-486e-9408-25696ec0c1e8 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:52.767494 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0d1abd11-36fe-486e-9408-25696ec0c1e8 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:52.767917 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0d1abd11-36fe-486e-9408-25696ec0c1e8 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:52.893708 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-0d1abd11-36fe-486e-9408-25696ec0c1e8 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961b9e63ece47e8934b7e4c7b5c46ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5318d2681e9d4fd2adc29977165e0a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:52.901242 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-0d1abd11-36fe-486e-9408-25696ec0c1e8 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] 10.222.0.42 "GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401" status: 200 len: 1358 microversion: 2.1 time: 0.146767 Sep 16 02:04:52.901797 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 439/889] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:04:52 2022] GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401 => generated 1358 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:04:53.270545 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-25268a6d-3499-4014-afd5-05079a47aef1 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:04:53.271215 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-25268a6d-3499-4014-afd5-05079a47aef1 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: edc72a68-5643-42ab-8bed-d8a70c4aaeef] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:04:53.277728 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-25268a6d-3499-4014-afd5-05079a47aef1 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:53.278210 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-25268a6d-3499-4014-afd5-05079a47aef1 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:53.278642 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-25268a6d-3499-4014-afd5-05079a47aef1 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:53.279328 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-25268a6d-3499-4014-afd5-05079a47aef1 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:53.279774 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-25268a6d-3499-4014-afd5-05079a47aef1 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:53.280231 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-25268a6d-3499-4014-afd5-05079a47aef1 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:53.409906 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-25268a6d-3499-4014-afd5-05079a47aef1 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:53.417551 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-25268a6d-3499-4014-afd5-05079a47aef1 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef" status: 200 len: 1364 microversion: 2.1 time: 0.150762 Sep 16 02:04:53.418340 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 451/890] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:04:53 2022] GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:04:53.925462 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-3b169dce-b72d-4c83-9665-d84baf5d0d4d tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:04:53.926179 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-3b169dce-b72d-4c83-9665-d84baf5d0d4d tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] [instance: 8351c196-00ce-4ff2-8c6d-b2464bfcf401] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:04:53.933011 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3b169dce-b72d-4c83-9665-d84baf5d0d4d tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:53.933609 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3b169dce-b72d-4c83-9665-d84baf5d0d4d tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:53.934119 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3b169dce-b72d-4c83-9665-d84baf5d0d4d tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:53.934819 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3b169dce-b72d-4c83-9665-d84baf5d0d4d tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:53.935278 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3b169dce-b72d-4c83-9665-d84baf5d0d4d tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:53.935707 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3b169dce-b72d-4c83-9665-d84baf5d0d4d tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:54.069780 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-3b169dce-b72d-4c83-9665-d84baf5d0d4d tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961b9e63ece47e8934b7e4c7b5c46ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5318d2681e9d4fd2adc29977165e0a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:54.079748 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-3b169dce-b72d-4c83-9665-d84baf5d0d4d tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] 10.222.0.42 "GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401" status: 200 len: 1358 microversion: 2.1 time: 0.159278 Sep 16 02:04:54.088755 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 440/891] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:04:53 2022] GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:04:54.441440 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-45a32697-84ad-4fb3-8eee-59704553de17 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:04:54.442003 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-45a32697-84ad-4fb3-8eee-59704553de17 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: edc72a68-5643-42ab-8bed-d8a70c4aaeef] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:04:54.448661 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-45a32697-84ad-4fb3-8eee-59704553de17 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:54.449158 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-45a32697-84ad-4fb3-8eee-59704553de17 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:54.449588 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-45a32697-84ad-4fb3-8eee-59704553de17 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:54.450291 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-45a32697-84ad-4fb3-8eee-59704553de17 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:54.450741 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-45a32697-84ad-4fb3-8eee-59704553de17 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:54.451163 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-45a32697-84ad-4fb3-8eee-59704553de17 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:54.579374 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-45a32697-84ad-4fb3-8eee-59704553de17 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:54.587003 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-45a32697-84ad-4fb3-8eee-59704553de17 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef" status: 200 len: 1364 microversion: 2.1 time: 0.150197 Sep 16 02:04:54.587578 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 452/892] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:04:54 2022] GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:04:55.102697 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-57cedd6e-3b2b-4cda-b843-c6916d17c295 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:04:55.103316 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-57cedd6e-3b2b-4cda-b843-c6916d17c295 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] [instance: 8351c196-00ce-4ff2-8c6d-b2464bfcf401] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:04:55.110528 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-57cedd6e-3b2b-4cda-b843-c6916d17c295 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:55.111020 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-57cedd6e-3b2b-4cda-b843-c6916d17c295 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:55.111460 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-57cedd6e-3b2b-4cda-b843-c6916d17c295 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:55.112206 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-57cedd6e-3b2b-4cda-b843-c6916d17c295 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:55.112697 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-57cedd6e-3b2b-4cda-b843-c6916d17c295 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:55.113129 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-57cedd6e-3b2b-4cda-b843-c6916d17c295 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:55.247551 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-57cedd6e-3b2b-4cda-b843-c6916d17c295 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961b9e63ece47e8934b7e4c7b5c46ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5318d2681e9d4fd2adc29977165e0a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:55.255526 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-57cedd6e-3b2b-4cda-b843-c6916d17c295 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] 10.222.0.42 "GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401" status: 200 len: 1358 microversion: 2.1 time: 0.156709 Sep 16 02:04:55.256121 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 441/893] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:04:55 2022] GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:04:55.610722 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-c0f2e438-bbc9-40dc-9534-c2ee39a006d7 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:04:55.611392 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-c0f2e438-bbc9-40dc-9534-c2ee39a006d7 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: edc72a68-5643-42ab-8bed-d8a70c4aaeef] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:04:55.617834 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c0f2e438-bbc9-40dc-9534-c2ee39a006d7 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:55.618311 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c0f2e438-bbc9-40dc-9534-c2ee39a006d7 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:55.618735 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c0f2e438-bbc9-40dc-9534-c2ee39a006d7 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:55.619452 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c0f2e438-bbc9-40dc-9534-c2ee39a006d7 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:55.620075 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c0f2e438-bbc9-40dc-9534-c2ee39a006d7 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:55.620452 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c0f2e438-bbc9-40dc-9534-c2ee39a006d7 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:55.901831 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-c0f2e438-bbc9-40dc-9534-c2ee39a006d7 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:55.909950 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-c0f2e438-bbc9-40dc-9534-c2ee39a006d7 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef" status: 200 len: 1364 microversion: 2.1 time: 0.303127 Sep 16 02:04:55.910521 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 453/894] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:04:55 2022] GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef => generated 1364 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:04:56.105460 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [req-11066ddd-df7d-4559-b852-28c718af6ed8 req-34691046-e080-42d5-b879-f6e06d3f0627 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8351c196-00ce-4ff2-8c6d-b2464bfcf401", "tag": "98214adc-c813-4c74-b55b-97383bfc06f7"}]} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:04:56.115711 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-11066ddd-df7d-4559-b852-28c718af6ed8 req-34691046-e080-42d5-b879-f6e06d3f0627 service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:56.116223 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-11066ddd-df7d-4559-b852-28c718af6ed8 req-34691046-e080-42d5-b879-f6e06d3f0627 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:56.116663 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-11066ddd-df7d-4559-b852-28c718af6ed8 req-34691046-e080-42d5-b879-f6e06d3f0627 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:56.128715 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.compute.server_external_events [req-11066ddd-df7d-4559-b852-28c718af6ed8 req-34691046-e080-42d5-b879-f6e06d3f0627 service nova] Creating event network-changed:98214adc-c813-4c74-b55b-97383bfc06f7 for instance 8351c196-00ce-4ff2-8c6d-b2464bfcf401 on hv-cinder-84914 Sep 16 02:04:56.133697 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [req-11066ddd-df7d-4559-b852-28c718af6ed8 req-34691046-e080-42d5-b879-f6e06d3f0627 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.173107 Sep 16 02:04:56.134318 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 442/895] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:04:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 02:04:56.278137 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-7fcb2512-6eed-4df5-b51f-d1d383bcc181 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:04:56.278857 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-7fcb2512-6eed-4df5-b51f-d1d383bcc181 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] [instance: 8351c196-00ce-4ff2-8c6d-b2464bfcf401] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:04:56.285364 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7fcb2512-6eed-4df5-b51f-d1d383bcc181 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:56.285850 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7fcb2512-6eed-4df5-b51f-d1d383bcc181 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:56.286279 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7fcb2512-6eed-4df5-b51f-d1d383bcc181 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:56.286959 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7fcb2512-6eed-4df5-b51f-d1d383bcc181 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:56.287402 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7fcb2512-6eed-4df5-b51f-d1d383bcc181 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:56.287816 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7fcb2512-6eed-4df5-b51f-d1d383bcc181 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:56.859124 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-7fcb2512-6eed-4df5-b51f-d1d383bcc181 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961b9e63ece47e8934b7e4c7b5c46ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5318d2681e9d4fd2adc29977165e0a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:56.866924 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-7fcb2512-6eed-4df5-b51f-d1d383bcc181 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] 10.222.0.42 "GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401" status: 200 len: 1358 microversion: 2.1 time: 0.592574 Sep 16 02:04:56.867496 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 454/896] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:04:56 2022] GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401 => generated 1358 bytes in 594 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:04:56.934953 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-28426d93-5b5e-49ff-8960-e1c9e77c7174 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:04:56.935988 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-28426d93-5b5e-49ff-8960-e1c9e77c7174 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: edc72a68-5643-42ab-8bed-d8a70c4aaeef] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:04:56.943363 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-28426d93-5b5e-49ff-8960-e1c9e77c7174 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:56.943974 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-28426d93-5b5e-49ff-8960-e1c9e77c7174 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:56.944494 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-28426d93-5b5e-49ff-8960-e1c9e77c7174 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:56.945284 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-28426d93-5b5e-49ff-8960-e1c9e77c7174 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:56.945812 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-28426d93-5b5e-49ff-8960-e1c9e77c7174 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:56.946310 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-28426d93-5b5e-49ff-8960-e1c9e77c7174 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:57.090273 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-28426d93-5b5e-49ff-8960-e1c9e77c7174 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:57.099728 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-28426d93-5b5e-49ff-8960-e1c9e77c7174 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef" status: 200 len: 1364 microversion: 2.1 time: 0.169445 Sep 16 02:04:57.107046 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 443/897] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:04:56 2022] GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef => generated 1364 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:04:57.891121 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-75a71859-aa6b-44b4-b548-44f3590f928d tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:04:57.891733 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-75a71859-aa6b-44b4-b548-44f3590f928d tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] [instance: 8351c196-00ce-4ff2-8c6d-b2464bfcf401] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:04:57.898533 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-75a71859-aa6b-44b4-b548-44f3590f928d tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:57.899015 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-75a71859-aa6b-44b4-b548-44f3590f928d tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:57.899455 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-75a71859-aa6b-44b4-b548-44f3590f928d tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:57.900179 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-75a71859-aa6b-44b4-b548-44f3590f928d tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:57.900636 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-75a71859-aa6b-44b4-b548-44f3590f928d tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:57.901058 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-75a71859-aa6b-44b4-b548-44f3590f928d tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:58.028976 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-75a71859-aa6b-44b4-b548-44f3590f928d tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961b9e63ece47e8934b7e4c7b5c46ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5318d2681e9d4fd2adc29977165e0a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:58.037103 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-75a71859-aa6b-44b4-b548-44f3590f928d tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] 10.222.0.42 "GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401" status: 200 len: 1358 microversion: 2.1 time: 0.150436 Sep 16 02:04:58.037667 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 455/898] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:04:57 2022] GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:04:58.123524 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-8e9d983b-5587-47df-ba78-9b16df8c2177 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:04:58.124726 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-8e9d983b-5587-47df-ba78-9b16df8c2177 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: edc72a68-5643-42ab-8bed-d8a70c4aaeef] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:04:58.131429 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8e9d983b-5587-47df-ba78-9b16df8c2177 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:58.131916 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8e9d983b-5587-47df-ba78-9b16df8c2177 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:58.132385 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8e9d983b-5587-47df-ba78-9b16df8c2177 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:58.133071 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8e9d983b-5587-47df-ba78-9b16df8c2177 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:58.133526 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8e9d983b-5587-47df-ba78-9b16df8c2177 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:58.133950 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8e9d983b-5587-47df-ba78-9b16df8c2177 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:58.148149 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [req-924cd72f-0003-4aa8-92c2-b6ffce47de62 req-1d83d3e5-96ba-4e70-a61a-69bd5549a24d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edc72a68-5643-42ab-8bed-d8a70c4aaeef", "tag": "aa7f0fa3-598c-4440-8ab1-72fe07d249af"}]} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:04:58.157503 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-924cd72f-0003-4aa8-92c2-b6ffce47de62 req-1d83d3e5-96ba-4e70-a61a-69bd5549a24d service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:58.158116 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-924cd72f-0003-4aa8-92c2-b6ffce47de62 req-1d83d3e5-96ba-4e70-a61a-69bd5549a24d service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:58.158547 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-924cd72f-0003-4aa8-92c2-b6ffce47de62 req-1d83d3e5-96ba-4e70-a61a-69bd5549a24d service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:58.162235 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell1:SELECT=100 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:04:58.171133 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.compute.server_external_events [req-924cd72f-0003-4aa8-92c2-b6ffce47de62 req-1d83d3e5-96ba-4e70-a61a-69bd5549a24d service nova] Creating event network-changed:aa7f0fa3-598c-4440-8ab1-72fe07d249af for instance edc72a68-5643-42ab-8bed-d8a70c4aaeef on hv-cinder-84914 Sep 16 02:04:58.176297 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [req-924cd72f-0003-4aa8-92c2-b6ffce47de62 req-1d83d3e5-96ba-4e70-a61a-69bd5549a24d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031899 Sep 16 02:04:58.177083 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 456/899] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:04:58 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 02:04:58.266356 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-8e9d983b-5587-47df-ba78-9b16df8c2177 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:58.273991 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-8e9d983b-5587-47df-ba78-9b16df8c2177 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef" status: 200 len: 1364 microversion: 2.1 time: 0.154362 Sep 16 02:04:58.274558 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 444/900] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:04:58 2022] GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:04:59.062205 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-97d55cb9-93db-4494-9b75-54690602dd40 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:04:59.062786 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-97d55cb9-93db-4494-9b75-54690602dd40 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] [instance: 8351c196-00ce-4ff2-8c6d-b2464bfcf401] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:04:59.068807 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-97d55cb9-93db-4494-9b75-54690602dd40 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:59.069284 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-97d55cb9-93db-4494-9b75-54690602dd40 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:59.069712 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-97d55cb9-93db-4494-9b75-54690602dd40 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:59.070379 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-97d55cb9-93db-4494-9b75-54690602dd40 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:59.070825 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-97d55cb9-93db-4494-9b75-54690602dd40 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:59.071241 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-97d55cb9-93db-4494-9b75-54690602dd40 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:59.201823 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-97d55cb9-93db-4494-9b75-54690602dd40 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961b9e63ece47e8934b7e4c7b5c46ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5318d2681e9d4fd2adc29977165e0a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:59.209994 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-97d55cb9-93db-4494-9b75-54690602dd40 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] 10.222.0.42 "GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401" status: 200 len: 1358 microversion: 2.1 time: 0.152709 Sep 16 02:04:59.210555 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 457/901] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:04:59 2022] GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:04:59.297471 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-d14a4ff3-8a65-4c08-a0b1-a866dfedeab8 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:04:59.298077 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-d14a4ff3-8a65-4c08-a0b1-a866dfedeab8 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: edc72a68-5643-42ab-8bed-d8a70c4aaeef] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:04:59.304426 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d14a4ff3-8a65-4c08-a0b1-a866dfedeab8 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:59.304909 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d14a4ff3-8a65-4c08-a0b1-a866dfedeab8 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:59.305344 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d14a4ff3-8a65-4c08-a0b1-a866dfedeab8 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:59.306052 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d14a4ff3-8a65-4c08-a0b1-a866dfedeab8 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:04:59.306508 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d14a4ff3-8a65-4c08-a0b1-a866dfedeab8 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:04:59.306934 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d14a4ff3-8a65-4c08-a0b1-a866dfedeab8 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:04:59.436113 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-d14a4ff3-8a65-4c08-a0b1-a866dfedeab8 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:04:59.444197 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-d14a4ff3-8a65-4c08-a0b1-a866dfedeab8 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef" status: 200 len: 1364 microversion: 2.1 time: 0.150769 Sep 16 02:04:59.444772 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 445/902] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:04:59 2022] GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:05:00.233245 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-73da70b0-727b-41a5-9c67-e2dc89661ab2 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:05:00.234409 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-73da70b0-727b-41a5-9c67-e2dc89661ab2 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] [instance: 8351c196-00ce-4ff2-8c6d-b2464bfcf401] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:05:00.240923 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-73da70b0-727b-41a5-9c67-e2dc89661ab2 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:05:00.241408 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-73da70b0-727b-41a5-9c67-e2dc89661ab2 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:05:00.241846 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-73da70b0-727b-41a5-9c67-e2dc89661ab2 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:05:00.242523 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-73da70b0-727b-41a5-9c67-e2dc89661ab2 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:05:00.242976 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-73da70b0-727b-41a5-9c67-e2dc89661ab2 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:05:00.243399 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-73da70b0-727b-41a5-9c67-e2dc89661ab2 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:05:00.369651 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-73da70b0-727b-41a5-9c67-e2dc89661ab2 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961b9e63ece47e8934b7e4c7b5c46ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5318d2681e9d4fd2adc29977165e0a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:05:00.377850 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-73da70b0-727b-41a5-9c67-e2dc89661ab2 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] 10.222.0.42 "GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401" status: 200 len: 1358 microversion: 2.1 time: 0.148475 Sep 16 02:05:00.378400 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 458/903] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:05:00 2022] GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401 => generated 1358 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:05:00.467519 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-371297d5-85ae-4e1b-b202-8c78cf0d0f16 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:05:00.468775 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-371297d5-85ae-4e1b-b202-8c78cf0d0f16 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: edc72a68-5643-42ab-8bed-d8a70c4aaeef] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:05:00.475254 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-371297d5-85ae-4e1b-b202-8c78cf0d0f16 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:05:00.475733 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-371297d5-85ae-4e1b-b202-8c78cf0d0f16 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:05:00.476204 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-371297d5-85ae-4e1b-b202-8c78cf0d0f16 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:05:00.476885 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-371297d5-85ae-4e1b-b202-8c78cf0d0f16 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:05:00.477334 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-371297d5-85ae-4e1b-b202-8c78cf0d0f16 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:05:00.477751 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-371297d5-85ae-4e1b-b202-8c78cf0d0f16 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:05:00.603519 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-371297d5-85ae-4e1b-b202-8c78cf0d0f16 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:05:00.611787 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-371297d5-85ae-4e1b-b202-8c78cf0d0f16 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef" status: 200 len: 1364 microversion: 2.1 time: 0.148095 Sep 16 02:05:00.612376 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 446/904] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:05:00 2022] GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef => generated 1364 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:05:01.400479 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-584097aa-70ff-41fb-a80f-c9b7a7084615 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:05:01.401131 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-584097aa-70ff-41fb-a80f-c9b7a7084615 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] [instance: 8351c196-00ce-4ff2-8c6d-b2464bfcf401] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:05:01.408500 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-584097aa-70ff-41fb-a80f-c9b7a7084615 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:05:01.408988 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-584097aa-70ff-41fb-a80f-c9b7a7084615 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:05:01.409425 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-584097aa-70ff-41fb-a80f-c9b7a7084615 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:05:01.410151 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-584097aa-70ff-41fb-a80f-c9b7a7084615 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:05:01.410605 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-584097aa-70ff-41fb-a80f-c9b7a7084615 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:05:01.411031 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-584097aa-70ff-41fb-a80f-c9b7a7084615 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:05:01.635487 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-0fe8cdcd-63e1-41f8-832e-6727282f4fc2 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:05:01.636206 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-0fe8cdcd-63e1-41f8-832e-6727282f4fc2 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: edc72a68-5643-42ab-8bed-d8a70c4aaeef] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:05:01.643095 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0fe8cdcd-63e1-41f8-832e-6727282f4fc2 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:05:01.643904 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0fe8cdcd-63e1-41f8-832e-6727282f4fc2 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:05:01.644387 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0fe8cdcd-63e1-41f8-832e-6727282f4fc2 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:05:01.645155 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0fe8cdcd-63e1-41f8-832e-6727282f4fc2 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:05:01.645614 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0fe8cdcd-63e1-41f8-832e-6727282f4fc2 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:05:01.646039 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0fe8cdcd-63e1-41f8-832e-6727282f4fc2 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:05:01.747251 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-584097aa-70ff-41fb-a80f-c9b7a7084615 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961b9e63ece47e8934b7e4c7b5c46ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5318d2681e9d4fd2adc29977165e0a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:05:01.755388 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-584097aa-70ff-41fb-a80f-c9b7a7084615 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] 10.222.0.42 "GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401" status: 200 len: 1358 microversion: 2.1 time: 0.358700 Sep 16 02:05:01.756632 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 459/905] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:05:01 2022] GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401 => generated 1358 bytes in 360 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:05:01.788085 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-0fe8cdcd-63e1-41f8-832e-6727282f4fc2 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:05:01.795649 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-0fe8cdcd-63e1-41f8-832e-6727282f4fc2 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef" status: 200 len: 1364 microversion: 2.1 time: 0.164681 Sep 16 02:05:01.797116 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 447/906] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:05:01 2022] GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef => generated 1364 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 02:05:02.778457 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-0ce35569-77df-483d-9f32-cd0dc3d78379 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:05:02.779075 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-0ce35569-77df-483d-9f32-cd0dc3d78379 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] [instance: 8351c196-00ce-4ff2-8c6d-b2464bfcf401] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:05:02.785649 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0ce35569-77df-483d-9f32-cd0dc3d78379 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:05:02.786133 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0ce35569-77df-483d-9f32-cd0dc3d78379 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:05:02.786572 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0ce35569-77df-483d-9f32-cd0dc3d78379 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:05:02.787253 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0ce35569-77df-483d-9f32-cd0dc3d78379 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:05:02.787708 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0ce35569-77df-483d-9f32-cd0dc3d78379 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:05:02.788162 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0ce35569-77df-483d-9f32-cd0dc3d78379 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:05:02.819308 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-2bcd265e-c629-4515-b81a-197a9a0ca112 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:05:02.819924 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-2bcd265e-c629-4515-b81a-197a9a0ca112 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: edc72a68-5643-42ab-8bed-d8a70c4aaeef] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:05:02.825983 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2bcd265e-c629-4515-b81a-197a9a0ca112 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:05:02.826474 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2bcd265e-c629-4515-b81a-197a9a0ca112 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:05:02.826915 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2bcd265e-c629-4515-b81a-197a9a0ca112 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:05:02.828586 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2bcd265e-c629-4515-b81a-197a9a0ca112 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:05:02.829077 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2bcd265e-c629-4515-b81a-197a9a0ca112 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:05:02.829513 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2bcd265e-c629-4515-b81a-197a9a0ca112 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:05:02.844459 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell1:SELECT=100 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:05:02.915712 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-0ce35569-77df-483d-9f32-cd0dc3d78379 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961b9e63ece47e8934b7e4c7b5c46ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5318d2681e9d4fd2adc29977165e0a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:05:02.924059 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-0ce35569-77df-483d-9f32-cd0dc3d78379 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] 10.222.0.42 "GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401" status: 200 len: 1358 microversion: 2.1 time: 0.149521 Sep 16 02:05:02.924624 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 460/907] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:05:02 2022] GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401 => generated 1358 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:05:02.957320 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-2bcd265e-c629-4515-b81a-197a9a0ca112 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:05:02.965008 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-2bcd265e-c629-4515-b81a-197a9a0ca112 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef" status: 200 len: 1364 microversion: 2.1 time: 0.150063 Sep 16 02:05:02.965576 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 448/908] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:05:02 2022] GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef => generated 1364 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 02:05:03.800241 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [req-2c648822-56d2-4443-83fe-a648545e5667 req-9d0ebfe2-30ed-4ac2-be32-ab646c98e4bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8351c196-00ce-4ff2-8c6d-b2464bfcf401", "name": "network-vif-plugged", "status": "completed", "tag": "98214adc-c813-4c74-b55b-97383bfc06f7"}]} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:05:03.810391 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-2c648822-56d2-4443-83fe-a648545e5667 req-9d0ebfe2-30ed-4ac2-be32-ab646c98e4bf service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:05:03.811091 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-2c648822-56d2-4443-83fe-a648545e5667 req-9d0ebfe2-30ed-4ac2-be32-ab646c98e4bf service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:05:03.811323 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-2c648822-56d2-4443-83fe-a648545e5667 req-9d0ebfe2-30ed-4ac2-be32-ab646c98e4bf service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:05:03.822790 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.compute.server_external_events [req-2c648822-56d2-4443-83fe-a648545e5667 req-9d0ebfe2-30ed-4ac2-be32-ab646c98e4bf service nova] Creating event network-vif-plugged:98214adc-c813-4c74-b55b-97383bfc06f7 for instance 8351c196-00ce-4ff2-8c6d-b2464bfcf401 on hv-cinder-84914 Sep 16 02:05:03.828910 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [req-2c648822-56d2-4443-83fe-a648545e5667 req-9d0ebfe2-30ed-4ac2-be32-ab646c98e4bf service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.095143 Sep 16 02:05:03.829718 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 461/909] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:05:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:05:03.946585 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-dd17ddd0-f9a7-4480-aa7c-a117c9d11650 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:05:03.947212 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-dd17ddd0-f9a7-4480-aa7c-a117c9d11650 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] [instance: 8351c196-00ce-4ff2-8c6d-b2464bfcf401] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:05:03.954158 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-dd17ddd0-f9a7-4480-aa7c-a117c9d11650 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:05:03.954821 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-dd17ddd0-f9a7-4480-aa7c-a117c9d11650 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:05:03.955238 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-dd17ddd0-f9a7-4480-aa7c-a117c9d11650 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:05:03.956031 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-dd17ddd0-f9a7-4480-aa7c-a117c9d11650 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:05:03.956490 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-dd17ddd0-f9a7-4480-aa7c-a117c9d11650 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:05:03.956915 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-dd17ddd0-f9a7-4480-aa7c-a117c9d11650 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:05:03.989581 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-3c21bd20-ba99-425d-8a30-10c5e288d03c tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:05:03.990301 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-3c21bd20-ba99-425d-8a30-10c5e288d03c tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: edc72a68-5643-42ab-8bed-d8a70c4aaeef] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:05:03.996598 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3c21bd20-ba99-425d-8a30-10c5e288d03c tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:05:03.997085 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3c21bd20-ba99-425d-8a30-10c5e288d03c tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:05:03.997521 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3c21bd20-ba99-425d-8a30-10c5e288d03c tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:05:03.998389 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3c21bd20-ba99-425d-8a30-10c5e288d03c tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:05:03.998908 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3c21bd20-ba99-425d-8a30-10c5e288d03c tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:05:03.999479 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3c21bd20-ba99-425d-8a30-10c5e288d03c tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:05:04.096546 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-dd17ddd0-f9a7-4480-aa7c-a117c9d11650 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961b9e63ece47e8934b7e4c7b5c46ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5318d2681e9d4fd2adc29977165e0a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:05:04.104211 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-dd17ddd0-f9a7-4480-aa7c-a117c9d11650 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] 10.222.0.42 "GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401" status: 200 len: 1358 microversion: 2.1 time: 0.161434 Sep 16 02:05:04.112989 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 449/910] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:05:03 2022] GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401 => generated 1358 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:05:04.182163 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-3c21bd20-ba99-425d-8a30-10c5e288d03c tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:05:04.189953 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-3c21bd20-ba99-425d-8a30-10c5e288d03c tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef" status: 200 len: 1364 microversion: 2.1 time: 0.205677 Sep 16 02:05:04.190533 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 462/911] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:05:03 2022] GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef => generated 1364 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 02:05:05.127457 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-1d1bbda1-cc2a-4bc2-aa64-609182e71373 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:05:05.128079 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-1d1bbda1-cc2a-4bc2-aa64-609182e71373 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] [instance: 8351c196-00ce-4ff2-8c6d-b2464bfcf401] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:05:05.134416 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1d1bbda1-cc2a-4bc2-aa64-609182e71373 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:05:05.134898 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1d1bbda1-cc2a-4bc2-aa64-609182e71373 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:05:05.135336 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1d1bbda1-cc2a-4bc2-aa64-609182e71373 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:05:05.136049 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1d1bbda1-cc2a-4bc2-aa64-609182e71373 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:05:05.136503 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1d1bbda1-cc2a-4bc2-aa64-609182e71373 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:05:05.136932 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1d1bbda1-cc2a-4bc2-aa64-609182e71373 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:05:05.212454 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-92cefae0-e79d-4e04-9fbc-09ff72da41a9 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:05:05.213527 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-92cefae0-e79d-4e04-9fbc-09ff72da41a9 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: edc72a68-5643-42ab-8bed-d8a70c4aaeef] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:05:05.219568 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-92cefae0-e79d-4e04-9fbc-09ff72da41a9 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:05:05.220084 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-92cefae0-e79d-4e04-9fbc-09ff72da41a9 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:05:05.220518 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-92cefae0-e79d-4e04-9fbc-09ff72da41a9 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:05:05.221202 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-92cefae0-e79d-4e04-9fbc-09ff72da41a9 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:05:05.221656 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-92cefae0-e79d-4e04-9fbc-09ff72da41a9 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:05:05.222077 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-92cefae0-e79d-4e04-9fbc-09ff72da41a9 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:05:05.265672 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-1d1bbda1-cc2a-4bc2-aa64-609182e71373 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961b9e63ece47e8934b7e4c7b5c46ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5318d2681e9d4fd2adc29977165e0a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:05:05.273442 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-1d1bbda1-cc2a-4bc2-aa64-609182e71373 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] 10.222.0.42 "GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401" status: 200 len: 1358 microversion: 2.1 time: 0.150691 Sep 16 02:05:05.274009 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 450/912] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:05:05 2022] GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401 => generated 1358 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:05:05.355719 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-92cefae0-e79d-4e04-9fbc-09ff72da41a9 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:05:05.363892 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-92cefae0-e79d-4e04-9fbc-09ff72da41a9 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef" status: 200 len: 1364 microversion: 2.1 time: 0.155323 Sep 16 02:05:05.364488 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 463/913] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:05:05 2022] GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef => generated 1364 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 02:05:05.844475 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [req-c7f48926-67dc-4fc2-a330-e28354bde5f2 req-dbb793c9-be88-4ca0-9ee8-171e1f6bf4a6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edc72a68-5643-42ab-8bed-d8a70c4aaeef", "name": "network-vif-plugged", "status": "completed", "tag": "aa7f0fa3-598c-4440-8ab1-72fe07d249af"}]} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:05:05.853971 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-c7f48926-67dc-4fc2-a330-e28354bde5f2 req-dbb793c9-be88-4ca0-9ee8-171e1f6bf4a6 service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:05:05.854438 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-c7f48926-67dc-4fc2-a330-e28354bde5f2 req-dbb793c9-be88-4ca0-9ee8-171e1f6bf4a6 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:05:05.854861 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-c7f48926-67dc-4fc2-a330-e28354bde5f2 req-dbb793c9-be88-4ca0-9ee8-171e1f6bf4a6 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:05:05.866226 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.compute.server_external_events [req-c7f48926-67dc-4fc2-a330-e28354bde5f2 req-dbb793c9-be88-4ca0-9ee8-171e1f6bf4a6 service nova] Creating event network-vif-plugged:aa7f0fa3-598c-4440-8ab1-72fe07d249af for instance edc72a68-5643-42ab-8bed-d8a70c4aaeef on hv-cinder-84914 Sep 16 02:05:05.871299 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [req-c7f48926-67dc-4fc2-a330-e28354bde5f2 req-dbb793c9-be88-4ca0-9ee8-171e1f6bf4a6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031053 Sep 16 02:05:05.871866 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 451/914] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:05:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:05:06.295646 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-762d481b-c7e8-4248-9d92-d57b371c384c tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:05:06.296441 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-762d481b-c7e8-4248-9d92-d57b371c384c tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] [instance: 8351c196-00ce-4ff2-8c6d-b2464bfcf401] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:05:06.302707 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-762d481b-c7e8-4248-9d92-d57b371c384c tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:05:06.303187 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-762d481b-c7e8-4248-9d92-d57b371c384c tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:05:06.303619 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-762d481b-c7e8-4248-9d92-d57b371c384c tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:05:06.304330 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-762d481b-c7e8-4248-9d92-d57b371c384c tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:05:06.304782 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-762d481b-c7e8-4248-9d92-d57b371c384c tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:05:06.305205 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-762d481b-c7e8-4248-9d92-d57b371c384c tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:05:06.389003 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-4ed2f782-43a4-4cc3-86af-8050f5e9bc30 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:05:06.390759 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-4ed2f782-43a4-4cc3-86af-8050f5e9bc30 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: edc72a68-5643-42ab-8bed-d8a70c4aaeef] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:05:06.396993 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-4ed2f782-43a4-4cc3-86af-8050f5e9bc30 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:05:06.397477 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-4ed2f782-43a4-4cc3-86af-8050f5e9bc30 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:05:06.397907 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-4ed2f782-43a4-4cc3-86af-8050f5e9bc30 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:05:06.398585 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-4ed2f782-43a4-4cc3-86af-8050f5e9bc30 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:05:06.399029 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-4ed2f782-43a4-4cc3-86af-8050f5e9bc30 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:05:06.399445 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-4ed2f782-43a4-4cc3-86af-8050f5e9bc30 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:05:06.435962 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-762d481b-c7e8-4248-9d92-d57b371c384c tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961b9e63ece47e8934b7e4c7b5c46ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5318d2681e9d4fd2adc29977165e0a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:05:06.443926 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-762d481b-c7e8-4248-9d92-d57b371c384c tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] 10.222.0.42 "GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401" status: 200 len: 1548 microversion: 2.1 time: 0.152062 Sep 16 02:05:06.444530 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 464/915] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:05:06 2022] GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401 => generated 1548 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:05:06.466274 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-1050311d-7757-4cc0-ad02-b9e24ca58bb4 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:05:06.466883 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-1050311d-7757-4cc0-ad02-b9e24ca58bb4 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] [instance: 8351c196-00ce-4ff2-8c6d-b2464bfcf401] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:05:06.473509 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1050311d-7757-4cc0-ad02-b9e24ca58bb4 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:05:06.473998 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1050311d-7757-4cc0-ad02-b9e24ca58bb4 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:05:06.474814 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1050311d-7757-4cc0-ad02-b9e24ca58bb4 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:05:06.475236 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1050311d-7757-4cc0-ad02-b9e24ca58bb4 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:05:06.475675 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1050311d-7757-4cc0-ad02-b9e24ca58bb4 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:05:06.476131 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1050311d-7757-4cc0-ad02-b9e24ca58bb4 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:05:06.534207 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-4ed2f782-43a4-4cc3-86af-8050f5e9bc30 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:05:06.542797 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-4ed2f782-43a4-4cc3-86af-8050f5e9bc30 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef" status: 200 len: 1364 microversion: 2.1 time: 0.158608 Sep 16 02:05:06.543385 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 452/916] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:05:06 2022] GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:05:06.607111 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-1050311d-7757-4cc0-ad02-b9e24ca58bb4 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961b9e63ece47e8934b7e4c7b5c46ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5318d2681e9d4fd2adc29977165e0a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:05:06.614967 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-1050311d-7757-4cc0-ad02-b9e24ca58bb4 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] 10.222.0.42 "GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401" status: 200 len: 1548 microversion: 2.1 time: 0.152471 Sep 16 02:05:06.615533 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 465/917] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:05:06 2022] GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401 => generated 1548 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 02:05:06.637264 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-0727fc2f-58d8-4160-baff-bb71dd7a641c tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:05:06.643296 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-0727fc2f-58d8-4160-baff-bb71dd7a641c tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'e961b9e63ece47e8934b7e4c7b5c46ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5318d2681e9d4fd2adc29977165e0a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:05:06.644082 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-0727fc2f-58d8-4160-baff-bb71dd7a641c tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Searching by: {'deleted': False, 'project_id': '5318d2681e9d4fd2adc29977165e0a9b'} {{(pid=120440) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 02:05:06.650522 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0727fc2f-58d8-4160-baff-bb71dd7a641c tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:05:06.650992 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0727fc2f-58d8-4160-baff-bb71dd7a641c tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:05:06.651419 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0727fc2f-58d8-4160-baff-bb71dd7a641c tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:05:06.652164 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0727fc2f-58d8-4160-baff-bb71dd7a641c tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:05:06.652614 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0727fc2f-58d8-4160-baff-bb71dd7a641c tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:05:06.653032 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0727fc2f-58d8-4160-baff-bb71dd7a641c tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:05:06.742504 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.multi_cell_list [None req-0727fc2f-58d8-4160-baff-bb71dd7a641c tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=120440) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 16 02:05:06.835467 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-0727fc2f-58d8-4160-baff-bb71dd7a641c tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] 10.222.0.42 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.201891 Sep 16 02:05:06.836072 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 453/918] 10.222.0.42 () {58 vars in 1125 bytes} [Fri Sep 16 02:05:06 2022] GET /compute/v2.1/servers => generated 343 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:05:06.847541 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-8af20e3f-1a81-4a97-abcb-a2029c83d94a tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:05:06.848186 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-8af20e3f-1a81-4a97-abcb-a2029c83d94a tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] [instance: 8351c196-00ce-4ff2-8c6d-b2464bfcf401] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:05:06.854054 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8af20e3f-1a81-4a97-abcb-a2029c83d94a tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:05:06.854535 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8af20e3f-1a81-4a97-abcb-a2029c83d94a tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:05:06.854968 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8af20e3f-1a81-4a97-abcb-a2029c83d94a tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:05:06.855645 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8af20e3f-1a81-4a97-abcb-a2029c83d94a tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:05:06.856149 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8af20e3f-1a81-4a97-abcb-a2029c83d94a tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:05:06.856573 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8af20e3f-1a81-4a97-abcb-a2029c83d94a tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:05:06.981281 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-8af20e3f-1a81-4a97-abcb-a2029c83d94a tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961b9e63ece47e8934b7e4c7b5c46ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5318d2681e9d4fd2adc29977165e0a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:05:06.989409 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-8af20e3f-1a81-4a97-abcb-a2029c83d94a tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] 10.222.0.42 "GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401" status: 200 len: 1548 microversion: 2.1 time: 0.145672 Sep 16 02:05:06.989970 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 466/919] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:05:06 2022] GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401 => generated 1548 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:05:07.565868 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-c9fba451-3e55-43cf-a234-862341759050 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:05:07.566816 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-c9fba451-3e55-43cf-a234-862341759050 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: edc72a68-5643-42ab-8bed-d8a70c4aaeef] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:05:07.573836 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c9fba451-3e55-43cf-a234-862341759050 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:05:07.574625 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c9fba451-3e55-43cf-a234-862341759050 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:05:07.575131 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c9fba451-3e55-43cf-a234-862341759050 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:05:07.575824 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c9fba451-3e55-43cf-a234-862341759050 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:05:07.576307 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c9fba451-3e55-43cf-a234-862341759050 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:05:07.576733 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c9fba451-3e55-43cf-a234-862341759050 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:05:07.711430 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-c9fba451-3e55-43cf-a234-862341759050 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:05:07.719731 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-c9fba451-3e55-43cf-a234-862341759050 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef" status: 200 len: 1364 microversion: 2.1 time: 0.157838 Sep 16 02:05:07.720339 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 454/920] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:05:07 2022] GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef => generated 1364 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:05:08.526147 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-10a4a0f5-5456-41f5-8643-b1513163667c tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "09d585d8-9c75-4ff4-b9a4-cb4e3bd9547b"}} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:05:08.528648 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-10a4a0f5-5456-41f5-8643-b1513163667c tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] [instance: 8351c196-00ce-4ff2-8c6d-b2464bfcf401] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:05:08.535848 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-10a4a0f5-5456-41f5-8643-b1513163667c tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:05:08.536379 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-10a4a0f5-5456-41f5-8643-b1513163667c tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:05:08.536815 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-10a4a0f5-5456-41f5-8643-b1513163667c tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:05:08.537505 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-10a4a0f5-5456-41f5-8643-b1513163667c tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:05:08.537958 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-10a4a0f5-5456-41f5-8643-b1513163667c tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:05:08.538381 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-10a4a0f5-5456-41f5-8643-b1513163667c tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:05:08.743013 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-c674c9eb-32be-4d43-b419-d549fb7be03c tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:05:08.743630 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-c674c9eb-32be-4d43-b419-d549fb7be03c tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: edc72a68-5643-42ab-8bed-d8a70c4aaeef] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:05:08.750857 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c674c9eb-32be-4d43-b419-d549fb7be03c tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:05:08.751406 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c674c9eb-32be-4d43-b419-d549fb7be03c tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:05:08.751839 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c674c9eb-32be-4d43-b419-d549fb7be03c tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:05:08.752640 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c674c9eb-32be-4d43-b419-d549fb7be03c tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:05:08.753184 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c674c9eb-32be-4d43-b419-d549fb7be03c tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:05:08.753632 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c674c9eb-32be-4d43-b419-d549fb7be03c tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:05:08.809837 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-10a4a0f5-5456-41f5-8643-b1513163667c tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] 10.222.0.42 "POST /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.287504 Sep 16 02:05:08.810749 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 467/921] 10.222.0.42 () {60 vars in 1323 bytes} [Fri Sep 16 02:05:08 2022] POST /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401/os-volume_attachments => generated 194 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:05:08.900657 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-c674c9eb-32be-4d43-b419-d549fb7be03c tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:05:08.908385 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-c674c9eb-32be-4d43-b419-d549fb7be03c tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef" status: 200 len: 1553 microversion: 2.1 time: 0.169554 Sep 16 02:05:08.909190 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 455/922] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:05:08 2022] GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef => generated 1553 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 02:05:08.931926 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-b0d9b9ff-352e-40a0-854e-0c8b8de1ae13 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:05:08.932528 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-b0d9b9ff-352e-40a0-854e-0c8b8de1ae13 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: edc72a68-5643-42ab-8bed-d8a70c4aaeef] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:05:08.939593 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b0d9b9ff-352e-40a0-854e-0c8b8de1ae13 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:05:08.940115 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b0d9b9ff-352e-40a0-854e-0c8b8de1ae13 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:05:08.940552 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b0d9b9ff-352e-40a0-854e-0c8b8de1ae13 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:05:08.941234 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b0d9b9ff-352e-40a0-854e-0c8b8de1ae13 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:05:08.941684 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b0d9b9ff-352e-40a0-854e-0c8b8de1ae13 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:05:08.942107 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b0d9b9ff-352e-40a0-854e-0c8b8de1ae13 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:05:09.020944 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-b0d9b9ff-352e-40a0-854e-0c8b8de1ae13 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.093616 Sep 16 02:05:09.021587 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 468/923] 10.222.0.42 () {58 vars in 1275 bytes} [Fri Sep 16 02:05:08 2022] GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef/os-interface => generated 284 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:05:10.218900 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [req-49270562-898e-4b27-a57b-0769852276c3 req-754c1fdb-7385-4fca-93c6-ff426b6ddc60 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "edc72a68-5643-42ab-8bed-d8a70c4aaeef", "tag": "aa7f0fa3-598c-4440-8ab1-72fe07d249af"}]} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:05:10.228842 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-49270562-898e-4b27-a57b-0769852276c3 req-754c1fdb-7385-4fca-93c6-ff426b6ddc60 service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:05:10.229300 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-49270562-898e-4b27-a57b-0769852276c3 req-754c1fdb-7385-4fca-93c6-ff426b6ddc60 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:05:10.229732 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-49270562-898e-4b27-a57b-0769852276c3 req-754c1fdb-7385-4fca-93c6-ff426b6ddc60 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:05:10.240485 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.compute.server_external_events [req-49270562-898e-4b27-a57b-0769852276c3 req-754c1fdb-7385-4fca-93c6-ff426b6ddc60 service nova] Creating event network-changed:aa7f0fa3-598c-4440-8ab1-72fe07d249af for instance edc72a68-5643-42ab-8bed-d8a70c4aaeef on hv-cinder-84914 Sep 16 02:05:10.245565 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [req-49270562-898e-4b27-a57b-0769852276c3 req-754c1fdb-7385-4fca-93c6-ff426b6ddc60 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030965 Sep 16 02:05:10.246398 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 456/924] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:05:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:05:16.414381 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-8f8e8a36-7197-40c4-89c9-77eda071a4f1 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:05:16.414986 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-8f8e8a36-7197-40c4-89c9-77eda071a4f1 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] [instance: 8351c196-00ce-4ff2-8c6d-b2464bfcf401] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:05:16.417001 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_api:SELECT=54 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:05:16.422657 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8f8e8a36-7197-40c4-89c9-77eda071a4f1 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:05:16.423137 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8f8e8a36-7197-40c4-89c9-77eda071a4f1 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:05:16.423572 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8f8e8a36-7197-40c4-89c9-77eda071a4f1 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:05:16.424290 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8f8e8a36-7197-40c4-89c9-77eda071a4f1 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:05:16.424739 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8f8e8a36-7197-40c4-89c9-77eda071a4f1 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:05:16.425160 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8f8e8a36-7197-40c4-89c9-77eda071a4f1 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:05:16.556462 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-8f8e8a36-7197-40c4-89c9-77eda071a4f1 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961b9e63ece47e8934b7e4c7b5c46ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5318d2681e9d4fd2adc29977165e0a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:05:16.564535 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-8f8e8a36-7197-40c4-89c9-77eda071a4f1 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] 10.222.0.42 "GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401" status: 200 len: 1594 microversion: 2.1 time: 0.154738 Sep 16 02:05:16.565090 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 469/925] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:05:16 2022] GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401 => generated 1594 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:05:18.337279 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [req-61dc8865-178e-470d-bbde-cb8a60586b05 req-1fe68f2f-80c3-48f9-abac-7ead1305c273 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8351c196-00ce-4ff2-8c6d-b2464bfcf401", "tag": "98214adc-c813-4c74-b55b-97383bfc06f7"}]} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:05:18.343731 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell0:SELECT=2 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:05:18.344293 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_api:SELECT=52 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:05:18.350347 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-61dc8865-178e-470d-bbde-cb8a60586b05 req-1fe68f2f-80c3-48f9-abac-7ead1305c273 service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:05:18.350828 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-61dc8865-178e-470d-bbde-cb8a60586b05 req-1fe68f2f-80c3-48f9-abac-7ead1305c273 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:05:18.351298 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-61dc8865-178e-470d-bbde-cb8a60586b05 req-1fe68f2f-80c3-48f9-abac-7ead1305c273 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:05:18.363095 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.compute.server_external_events [req-61dc8865-178e-470d-bbde-cb8a60586b05 req-1fe68f2f-80c3-48f9-abac-7ead1305c273 service nova] Creating event network-changed:98214adc-c813-4c74-b55b-97383bfc06f7 for instance 8351c196-00ce-4ff2-8c6d-b2464bfcf401 on hv-cinder-84914 Sep 16 02:05:18.368206 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [req-61dc8865-178e-470d-bbde-cb8a60586b05 req-1fe68f2f-80c3-48f9-abac-7ead1305c273 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034907 Sep 16 02:05:18.369085 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 457/926] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:05:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 02:05:19.335085 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-84ce6d65-3f1b-4d47-9c41-2d59c15c3dbb tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-668937438"}} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:05:19.335626 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-84ce6d65-3f1b-4d47-9c41-2d59c15c3dbb tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] [instance: 8351c196-00ce-4ff2-8c6d-b2464bfcf401] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:05:19.342213 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-84ce6d65-3f1b-4d47-9c41-2d59c15c3dbb tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:05:19.343330 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-84ce6d65-3f1b-4d47-9c41-2d59c15c3dbb tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:05:19.343772 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-84ce6d65-3f1b-4d47-9c41-2d59c15c3dbb tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:05:19.344753 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-84ce6d65-3f1b-4d47-9c41-2d59c15c3dbb tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:05:19.345207 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-84ce6d65-3f1b-4d47-9c41-2d59c15c3dbb tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:05:19.345634 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-84ce6d65-3f1b-4d47-9c41-2d59c15c3dbb tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:05:19.496176 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.network.security_group_api [None req-84ce6d65-3f1b-4d47-9c41-2d59c15c3dbb tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Adding security group 8a773f28-2b0d-4a48-8338-85d0f80a6d4d to port 98214adc-c813-4c74-b55b-97383bfc06f7 Sep 16 02:05:19.813852 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-84ce6d65-3f1b-4d47-9c41-2d59c15c3dbb tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] 10.222.0.42 "POST /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401/action" status: 202 len: 0 microversion: 2.1 time: 0.483654 Sep 16 02:05:19.814497 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 470/927] 10.222.0.42 () {60 vars in 1278 bytes} [Fri Sep 16 02:05:19 2022] POST /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401/action => generated 0 bytes in 485 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 02:05:19.823562 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-687fde3c-4321-4467-afaa-de2a085696e5 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:05:19.824286 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-687fde3c-4321-4467-afaa-de2a085696e5 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] [instance: 8351c196-00ce-4ff2-8c6d-b2464bfcf401] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:05:19.831216 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-687fde3c-4321-4467-afaa-de2a085696e5 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:05:19.831699 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-687fde3c-4321-4467-afaa-de2a085696e5 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:05:19.832171 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-687fde3c-4321-4467-afaa-de2a085696e5 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:05:19.832879 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-687fde3c-4321-4467-afaa-de2a085696e5 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:05:19.833327 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-687fde3c-4321-4467-afaa-de2a085696e5 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:05:19.833757 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-687fde3c-4321-4467-afaa-de2a085696e5 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:05:19.981616 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-687fde3c-4321-4467-afaa-de2a085696e5 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961b9e63ece47e8934b7e4c7b5c46ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5318d2681e9d4fd2adc29977165e0a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:05:19.990060 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-687fde3c-4321-4467-afaa-de2a085696e5 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] 10.222.0.42 "GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401" status: 200 len: 1758 microversion: 2.1 time: 0.171231 Sep 16 02:05:19.990643 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 458/928] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:05:19 2022] GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401 => generated 1758 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:05:20.383017 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [req-9976a67f-682b-453d-8ee8-caa60830b73c req-52fd9fd1-8180-4219-aa10-a73b3a1ebcf4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8351c196-00ce-4ff2-8c6d-b2464bfcf401", "tag": "98214adc-c813-4c74-b55b-97383bfc06f7"}]} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:05:20.393135 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-9976a67f-682b-453d-8ee8-caa60830b73c req-52fd9fd1-8180-4219-aa10-a73b3a1ebcf4 service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:05:20.393620 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-9976a67f-682b-453d-8ee8-caa60830b73c req-52fd9fd1-8180-4219-aa10-a73b3a1ebcf4 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:05:20.394045 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-9976a67f-682b-453d-8ee8-caa60830b73c req-52fd9fd1-8180-4219-aa10-a73b3a1ebcf4 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:05:20.405337 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.compute.server_external_events [req-9976a67f-682b-453d-8ee8-caa60830b73c req-52fd9fd1-8180-4219-aa10-a73b3a1ebcf4 service nova] Creating event network-changed:98214adc-c813-4c74-b55b-97383bfc06f7 for instance 8351c196-00ce-4ff2-8c6d-b2464bfcf401 on hv-cinder-84914 Sep 16 02:05:20.410463 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [req-9976a67f-682b-453d-8ee8-caa60830b73c req-52fd9fd1-8180-4219-aa10-a73b3a1ebcf4 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031550 Sep 16 02:05:20.411276 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 471/929] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:05:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:06:20.500305 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_api:SELECT=3 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:06:20.501058 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell1:SELECT=53 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:06:20.505985 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-41fc4c23-1012-4219-ae55-46fd1b361b82 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:06:20.508332 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-41fc4c23-1012-4219-ae55-46fd1b361b82 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] [instance: 8351c196-00ce-4ff2-8c6d-b2464bfcf401] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:06:20.515328 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-41fc4c23-1012-4219-ae55-46fd1b361b82 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:06:20.515814 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-41fc4c23-1012-4219-ae55-46fd1b361b82 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:06:20.516291 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-41fc4c23-1012-4219-ae55-46fd1b361b82 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:06:20.516984 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-41fc4c23-1012-4219-ae55-46fd1b361b82 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:06:20.517441 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-41fc4c23-1012-4219-ae55-46fd1b361b82 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:06:20.517873 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-41fc4c23-1012-4219-ae55-46fd1b361b82 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:06:20.588704 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-41fc4c23-1012-4219-ae55-46fd1b361b82 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] 10.222.0.42 "POST /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401/action" status: 202 len: 0 microversion: 2.1 time: 0.090190 Sep 16 02:06:20.589379 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 459/930] 10.222.0.42 () {60 vars in 1278 bytes} [Fri Sep 16 02:06:20 2022] POST /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401/action => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 02:06:20.595737 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_api:SELECT=5 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:06:20.596512 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:06:20.602014 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-dc13dce5-aadc-464c-9895-75cd8615a24b tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:06:20.602726 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-dc13dce5-aadc-464c-9895-75cd8615a24b tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] [instance: 8351c196-00ce-4ff2-8c6d-b2464bfcf401] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:06:20.610363 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-dc13dce5-aadc-464c-9895-75cd8615a24b tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:06:20.610856 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-dc13dce5-aadc-464c-9895-75cd8615a24b tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:06:20.611331 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-dc13dce5-aadc-464c-9895-75cd8615a24b tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:06:20.612015 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-dc13dce5-aadc-464c-9895-75cd8615a24b tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:06:20.612478 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-dc13dce5-aadc-464c-9895-75cd8615a24b tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:06:20.612960 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-dc13dce5-aadc-464c-9895-75cd8615a24b tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:06:20.831057 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-dc13dce5-aadc-464c-9895-75cd8615a24b tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961b9e63ece47e8934b7e4c7b5c46ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5318d2681e9d4fd2adc29977165e0a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:06:20.840001 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-dc13dce5-aadc-464c-9895-75cd8615a24b tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] 10.222.0.42 "GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401" status: 200 len: 1750 microversion: 2.1 time: 0.246284 Sep 16 02:06:20.840576 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 472/931] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:06:20 2022] GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401 => generated 1750 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:06:21.865393 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-958f1dc0-bdfd-4fa3-b839-b2735192ce2f tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:06:21.866083 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-958f1dc0-bdfd-4fa3-b839-b2735192ce2f tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] [instance: 8351c196-00ce-4ff2-8c6d-b2464bfcf401] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:06:21.872237 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-958f1dc0-bdfd-4fa3-b839-b2735192ce2f tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:06:21.872714 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-958f1dc0-bdfd-4fa3-b839-b2735192ce2f tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:06:21.873144 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-958f1dc0-bdfd-4fa3-b839-b2735192ce2f tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:06:21.873817 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-958f1dc0-bdfd-4fa3-b839-b2735192ce2f tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:06:21.874518 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-958f1dc0-bdfd-4fa3-b839-b2735192ce2f tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:06:21.874936 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-958f1dc0-bdfd-4fa3-b839-b2735192ce2f tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:06:22.022426 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-958f1dc0-bdfd-4fa3-b839-b2735192ce2f tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961b9e63ece47e8934b7e4c7b5c46ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5318d2681e9d4fd2adc29977165e0a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:06:22.030891 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-958f1dc0-bdfd-4fa3-b839-b2735192ce2f tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] 10.222.0.42 "GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401" status: 200 len: 1755 microversion: 2.1 time: 0.171291 Sep 16 02:06:22.031470 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 460/932] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:06:21 2022] GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401 => generated 1755 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:06:23.055457 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-769d4eeb-940f-4f74-8ea6-48f5db11661d tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:06:23.056128 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-769d4eeb-940f-4f74-8ea6-48f5db11661d tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] [instance: 8351c196-00ce-4ff2-8c6d-b2464bfcf401] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:06:23.062189 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-769d4eeb-940f-4f74-8ea6-48f5db11661d tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:06:23.062635 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-769d4eeb-940f-4f74-8ea6-48f5db11661d tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:06:23.063066 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-769d4eeb-940f-4f74-8ea6-48f5db11661d tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:06:23.063736 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-769d4eeb-940f-4f74-8ea6-48f5db11661d tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:06:23.064207 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-769d4eeb-940f-4f74-8ea6-48f5db11661d tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:06:23.064629 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-769d4eeb-940f-4f74-8ea6-48f5db11661d tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:06:23.206505 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-769d4eeb-940f-4f74-8ea6-48f5db11661d tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961b9e63ece47e8934b7e4c7b5c46ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5318d2681e9d4fd2adc29977165e0a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:06:23.214628 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-769d4eeb-940f-4f74-8ea6-48f5db11661d tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] 10.222.0.42 "GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401" status: 200 len: 1755 microversion: 2.1 time: 0.163960 Sep 16 02:06:23.215195 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 473/933] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:06:23 2022] GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:06:24.239421 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-a7a99db4-abbc-4dd7-b339-b2a7273a2c20 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:06:24.240134 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-a7a99db4-abbc-4dd7-b339-b2a7273a2c20 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] [instance: 8351c196-00ce-4ff2-8c6d-b2464bfcf401] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:06:24.246460 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a7a99db4-abbc-4dd7-b339-b2a7273a2c20 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:06:24.246933 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a7a99db4-abbc-4dd7-b339-b2a7273a2c20 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:06:24.247363 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a7a99db4-abbc-4dd7-b339-b2a7273a2c20 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:06:24.248068 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a7a99db4-abbc-4dd7-b339-b2a7273a2c20 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:06:24.248514 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a7a99db4-abbc-4dd7-b339-b2a7273a2c20 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:06:24.248927 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a7a99db4-abbc-4dd7-b339-b2a7273a2c20 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:06:24.387805 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-a7a99db4-abbc-4dd7-b339-b2a7273a2c20 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961b9e63ece47e8934b7e4c7b5c46ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5318d2681e9d4fd2adc29977165e0a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:06:24.396144 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-a7a99db4-abbc-4dd7-b339-b2a7273a2c20 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] 10.222.0.42 "GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401" status: 200 len: 1755 microversion: 2.1 time: 0.161149 Sep 16 02:06:24.396715 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 461/934] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:06:24 2022] GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401 => generated 1755 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:06:25.174317 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-47f7daec-06b5-4325-a0a9-570f59f4f333 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:06:25.174894 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-47f7daec-06b5-4325-a0a9-570f59f4f333 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: edc72a68-5643-42ab-8bed-d8a70c4aaeef] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:06:25.182083 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-47f7daec-06b5-4325-a0a9-570f59f4f333 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:06:25.182557 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-47f7daec-06b5-4325-a0a9-570f59f4f333 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:06:25.182988 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-47f7daec-06b5-4325-a0a9-570f59f4f333 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:06:25.183659 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-47f7daec-06b5-4325-a0a9-570f59f4f333 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:06:25.184154 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-47f7daec-06b5-4325-a0a9-570f59f4f333 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:06:25.184574 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-47f7daec-06b5-4325-a0a9-570f59f4f333 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:06:25.208336 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-47f7daec-06b5-4325-a0a9-570f59f4f333 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef/ips" status: 200 len: 149 microversion: 2.1 time: 0.037214 Sep 16 02:06:25.208920 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 474/935] 10.222.0.42 () {58 vars in 1248 bytes} [Fri Sep 16 02:06:25 2022] GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef/ips => generated 149 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:06:25.420474 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-594314c8-6b15-4f4b-ae21-5210986565ca tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:06:25.421226 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-594314c8-6b15-4f4b-ae21-5210986565ca tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] [instance: 8351c196-00ce-4ff2-8c6d-b2464bfcf401] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:06:25.430567 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-594314c8-6b15-4f4b-ae21-5210986565ca tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:06:25.431167 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-594314c8-6b15-4f4b-ae21-5210986565ca tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:06:25.431714 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-594314c8-6b15-4f4b-ae21-5210986565ca tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:06:25.432556 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-594314c8-6b15-4f4b-ae21-5210986565ca tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:06:25.433192 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-594314c8-6b15-4f4b-ae21-5210986565ca tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:06:25.433633 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-594314c8-6b15-4f4b-ae21-5210986565ca tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:06:25.592451 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-594314c8-6b15-4f4b-ae21-5210986565ca tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961b9e63ece47e8934b7e4c7b5c46ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5318d2681e9d4fd2adc29977165e0a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:06:25.601197 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-594314c8-6b15-4f4b-ae21-5210986565ca tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] 10.222.0.42 "GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401" status: 200 len: 1755 microversion: 2.1 time: 0.185528 Sep 16 02:06:25.601759 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 462/936] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:06:25 2022] GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401 => generated 1755 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:06:26.581427 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-6efaebbf-f2bc-439a-9c5c-b7e9f55c871b tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6606f59b-cb62-4b63-a0b8-409ca6996e63"}} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:06:26.583876 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-6efaebbf-f2bc-439a-9c5c-b7e9f55c871b tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: edc72a68-5643-42ab-8bed-d8a70c4aaeef] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:06:26.590454 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-6efaebbf-f2bc-439a-9c5c-b7e9f55c871b tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:06:26.590927 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-6efaebbf-f2bc-439a-9c5c-b7e9f55c871b tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:06:26.591356 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-6efaebbf-f2bc-439a-9c5c-b7e9f55c871b tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:06:26.592053 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-6efaebbf-f2bc-439a-9c5c-b7e9f55c871b tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:06:26.592503 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-6efaebbf-f2bc-439a-9c5c-b7e9f55c871b tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:06:26.592919 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-6efaebbf-f2bc-439a-9c5c-b7e9f55c871b tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:06:26.624817 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-aeee64b2-db5c-43c6-913a-90ad9b827727 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:06:26.625431 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-aeee64b2-db5c-43c6-913a-90ad9b827727 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] [instance: 8351c196-00ce-4ff2-8c6d-b2464bfcf401] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:06:26.632598 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-aeee64b2-db5c-43c6-913a-90ad9b827727 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:06:26.633120 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-aeee64b2-db5c-43c6-913a-90ad9b827727 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:06:26.633609 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-aeee64b2-db5c-43c6-913a-90ad9b827727 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:06:26.634308 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-aeee64b2-db5c-43c6-913a-90ad9b827727 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:06:26.634764 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-aeee64b2-db5c-43c6-913a-90ad9b827727 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:06:26.635189 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-aeee64b2-db5c-43c6-913a-90ad9b827727 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:06:26.786671 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-aeee64b2-db5c-43c6-913a-90ad9b827727 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961b9e63ece47e8934b7e4c7b5c46ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5318d2681e9d4fd2adc29977165e0a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:06:26.794895 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-aeee64b2-db5c-43c6-913a-90ad9b827727 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] 10.222.0.42 "GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401" status: 200 len: 1755 microversion: 2.1 time: 0.174224 Sep 16 02:06:26.795465 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 463/937] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:06:26 2022] GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401 => generated 1755 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 02:06:26.863320 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-6efaebbf-f2bc-439a-9c5c-b7e9f55c871b tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "POST /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.285646 Sep 16 02:06:26.868156 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 475/938] 10.222.0.42 () {60 vars in 1323 bytes} [Fri Sep 16 02:06:26 2022] POST /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef/os-volume_attachments => generated 194 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:06:27.819488 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-dcbe2853-c2fe-4d55-ac60-f37127944236 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:06:27.820130 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-dcbe2853-c2fe-4d55-ac60-f37127944236 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] [instance: 8351c196-00ce-4ff2-8c6d-b2464bfcf401] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:06:27.826404 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-dcbe2853-c2fe-4d55-ac60-f37127944236 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:06:27.826877 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-dcbe2853-c2fe-4d55-ac60-f37127944236 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:06:27.827305 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-dcbe2853-c2fe-4d55-ac60-f37127944236 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:06:27.828000 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-dcbe2853-c2fe-4d55-ac60-f37127944236 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:06:27.828446 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-dcbe2853-c2fe-4d55-ac60-f37127944236 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:06:27.828860 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-dcbe2853-c2fe-4d55-ac60-f37127944236 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:06:27.970947 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-dcbe2853-c2fe-4d55-ac60-f37127944236 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961b9e63ece47e8934b7e4c7b5c46ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5318d2681e9d4fd2adc29977165e0a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:06:27.979691 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-dcbe2853-c2fe-4d55-ac60-f37127944236 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] 10.222.0.42 "GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401" status: 200 len: 1755 microversion: 2.1 time: 0.164930 Sep 16 02:06:27.980300 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 464/939] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:06:27 2022] GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:06:29.003297 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-f1ae5eed-f975-4b90-af4d-0aac03acf59e tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:06:29.004109 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-f1ae5eed-f975-4b90-af4d-0aac03acf59e tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] [instance: 8351c196-00ce-4ff2-8c6d-b2464bfcf401] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:06:29.011496 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f1ae5eed-f975-4b90-af4d-0aac03acf59e tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:06:29.012018 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f1ae5eed-f975-4b90-af4d-0aac03acf59e tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:06:29.012461 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f1ae5eed-f975-4b90-af4d-0aac03acf59e tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:06:29.013146 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f1ae5eed-f975-4b90-af4d-0aac03acf59e tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:06:29.013603 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f1ae5eed-f975-4b90-af4d-0aac03acf59e tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:06:29.014027 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f1ae5eed-f975-4b90-af4d-0aac03acf59e tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:06:29.156056 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-f1ae5eed-f975-4b90-af4d-0aac03acf59e tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961b9e63ece47e8934b7e4c7b5c46ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5318d2681e9d4fd2adc29977165e0a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:06:29.164144 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-f1ae5eed-f975-4b90-af4d-0aac03acf59e tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] 10.222.0.42 "GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401" status: 200 len: 1755 microversion: 2.1 time: 0.165299 Sep 16 02:06:29.164704 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 476/940] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:06:28 2022] GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401 => generated 1755 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:06:30.186652 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-79fbf924-9c89-4328-be23-e2b21ea0199a tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:06:30.187257 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-79fbf924-9c89-4328-be23-e2b21ea0199a tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] [instance: 8351c196-00ce-4ff2-8c6d-b2464bfcf401] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:06:30.193802 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-79fbf924-9c89-4328-be23-e2b21ea0199a tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:06:30.194278 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-79fbf924-9c89-4328-be23-e2b21ea0199a tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:06:30.194706 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-79fbf924-9c89-4328-be23-e2b21ea0199a tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:06:30.195381 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-79fbf924-9c89-4328-be23-e2b21ea0199a tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:06:30.195833 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-79fbf924-9c89-4328-be23-e2b21ea0199a tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:06:30.196276 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-79fbf924-9c89-4328-be23-e2b21ea0199a tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:06:30.341118 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-79fbf924-9c89-4328-be23-e2b21ea0199a tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961b9e63ece47e8934b7e4c7b5c46ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5318d2681e9d4fd2adc29977165e0a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:06:30.350114 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-79fbf924-9c89-4328-be23-e2b21ea0199a tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] 10.222.0.42 "GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401" status: 200 len: 1755 microversion: 2.1 time: 0.167019 Sep 16 02:06:30.350678 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 465/941] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:06:30 2022] GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401 => generated 1755 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:06:31.372976 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-535aca3b-a6cc-4b16-907d-0ed6af253bd7 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:06:31.373506 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-535aca3b-a6cc-4b16-907d-0ed6af253bd7 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] [instance: 8351c196-00ce-4ff2-8c6d-b2464bfcf401] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:06:31.380384 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-535aca3b-a6cc-4b16-907d-0ed6af253bd7 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:06:31.380994 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-535aca3b-a6cc-4b16-907d-0ed6af253bd7 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:06:31.381424 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-535aca3b-a6cc-4b16-907d-0ed6af253bd7 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:06:31.382098 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-535aca3b-a6cc-4b16-907d-0ed6af253bd7 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:06:31.382542 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-535aca3b-a6cc-4b16-907d-0ed6af253bd7 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:06:31.382964 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-535aca3b-a6cc-4b16-907d-0ed6af253bd7 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:06:31.526227 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-535aca3b-a6cc-4b16-907d-0ed6af253bd7 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961b9e63ece47e8934b7e4c7b5c46ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5318d2681e9d4fd2adc29977165e0a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:06:31.534350 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-535aca3b-a6cc-4b16-907d-0ed6af253bd7 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] 10.222.0.42 "GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401" status: 200 len: 1755 microversion: 2.1 time: 0.165320 Sep 16 02:06:31.534914 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 477/942] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:06:31 2022] GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401 => generated 1755 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:06:32.559012 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-6043e6a3-e92b-42a4-a66a-10e3eb633748 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:06:32.559624 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-6043e6a3-e92b-42a4-a66a-10e3eb633748 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] [instance: 8351c196-00ce-4ff2-8c6d-b2464bfcf401] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:06:32.565678 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6043e6a3-e92b-42a4-a66a-10e3eb633748 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:06:32.566151 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6043e6a3-e92b-42a4-a66a-10e3eb633748 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:06:32.566580 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6043e6a3-e92b-42a4-a66a-10e3eb633748 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:06:32.567254 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6043e6a3-e92b-42a4-a66a-10e3eb633748 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:06:32.568312 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6043e6a3-e92b-42a4-a66a-10e3eb633748 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:06:32.568844 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6043e6a3-e92b-42a4-a66a-10e3eb633748 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:06:32.706305 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-6043e6a3-e92b-42a4-a66a-10e3eb633748 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961b9e63ece47e8934b7e4c7b5c46ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5318d2681e9d4fd2adc29977165e0a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:06:32.714673 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-6043e6a3-e92b-42a4-a66a-10e3eb633748 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] 10.222.0.42 "GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401" status: 200 len: 1758 microversion: 2.1 time: 0.159660 Sep 16 02:06:32.715233 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 466/943] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:06:32 2022] GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401 => generated 1758 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:06:34.404441 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-7338495f-60fa-441e-87fa-61f358373cc8 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Action: 'create', calling method: .version_select at 0x7fae36188b80>, body: {"keypair": {"name": "tempest-keypair-735069941", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMJl+1n9q0+5CH161R5pSE3NBA5u3cBBc3It94l9pDLzuzPiwF1ra+JFkQivGQrpdCUcQBxdzsobrqiE76jawFljnEoQdqNq86e7/liZKiH1q2V7VlCrsdTOD1GFMEnaOA=="}} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:06:34.420707 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.quota [None req-7338495f-60fa-441e-87fa-61f358373cc8 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Getting quotas for project 663bde66131d47159ffa09ad33971895. Resources: {'key_pairs'} {{(pid=120441) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 02:06:34.424427 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.quota [None req-7338495f-60fa-441e-87fa-61f358373cc8 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Getting quotas for user 86bc1b5163f4453db4469fef90f27344 and project 663bde66131d47159ffa09ad33971895. Resources: {'key_pairs'} {{(pid=120441) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 02:06:34.445707 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-7338495f-60fa-441e-87fa-61f358373cc8 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.045038 Sep 16 02:06:34.446281 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 478/944] 10.222.0.42 () {60 vars in 1159 bytes} [Fri Sep 16 02:06:34 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:06:35.921076 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-d33d26bb-1f34-47e2-9c50-bc30ec56d0d6 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-920231979", "imageRef": "1546da04-912c-44c6-b4b9-34fba35e08f6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "80b93367-5ee2-4183-922b-cb2be17dc7b7"}], "security_groups": [{"name": "tempest-securitygroup--757526286"}], "key_name": "tempest-keypair-735069941", "user_data": "}} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:06:36.025092 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.network.neutron [None req-d33d26bb-1f34-47e2-9c50-bc30ec56d0d6 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] validate_networks() for [('80b93367-5ee2-4183-922b-cb2be17dc7b7', None, None, None, None, None)] {{(pid=120440) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 02:06:36.439301 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.virt.hardware [None req-d33d26bb-1f34-47e2-9c50-bc30ec56d0d6 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Flavor limits 0:0:0 {{(pid=120440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 02:06:36.439724 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.virt.hardware [None req-d33d26bb-1f34-47e2-9c50-bc30ec56d0d6 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Image limits 0:0:0 {{(pid=120440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 02:06:36.440241 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.virt.hardware [None req-d33d26bb-1f34-47e2-9c50-bc30ec56d0d6 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Flavor pref 0:0:0 {{(pid=120440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 02:06:36.440683 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.virt.hardware [None req-d33d26bb-1f34-47e2-9c50-bc30ec56d0d6 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Image pref 0:0:0 {{(pid=120440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 02:06:36.441123 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.virt.hardware [None req-d33d26bb-1f34-47e2-9c50-bc30ec56d0d6 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 02:06:36.449898 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d33d26bb-1f34-47e2-9c50-bc30ec56d0d6 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:06:36.450370 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d33d26bb-1f34-47e2-9c50-bc30ec56d0d6 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:06:36.450801 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d33d26bb-1f34-47e2-9c50-bc30ec56d0d6 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:06:36.451548 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d33d26bb-1f34-47e2-9c50-bc30ec56d0d6 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:06:36.452034 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d33d26bb-1f34-47e2-9c50-bc30ec56d0d6 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:06:36.452459 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d33d26bb-1f34-47e2-9c50-bc30ec56d0d6 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:06:36.468933 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.quota [None req-d33d26bb-1f34-47e2-9c50-bc30ec56d0d6 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Getting quotas for project 663bde66131d47159ffa09ad33971895. Resources: {'cores', 'ram', 'instances'} {{(pid=120440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 02:06:36.472781 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.quota [None req-d33d26bb-1f34-47e2-9c50-bc30ec56d0d6 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Getting quotas for user 86bc1b5163f4453db4469fef90f27344 and project 663bde66131d47159ffa09ad33971895. Resources: {'cores', 'ram', 'instances'} {{(pid=120440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 02:06:36.484009 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-d33d26bb-1f34-47e2-9c50-bc30ec56d0d6 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Going to run 1 instances... {{(pid=120440) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 02:06:36.486311 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-d33d26bb-1f34-47e2-9c50-bc30ec56d0d6 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: 6dcfb746-60d5-48b0-ab19-2d7a235860df] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1546da04-912c-44c6-b4b9-34fba35e08f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 02:06:36.532059 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-d33d26bb-1f34-47e2-9c50-bc30ec56d0d6 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.615362 Sep 16 02:06:36.532946 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 467/945] 10.222.0.42 () {60 vars in 1147 bytes} [Fri Sep 16 02:06:35 2022] POST /compute/v2.1/servers => generated 401 bytes in 617 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 02:06:36.545160 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-e183bfcb-a830-43cb-8a98-93856ab0d27c tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:06:36.545804 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-e183bfcb-a830-43cb-8a98-93856ab0d27c tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: 6dcfb746-60d5-48b0-ab19-2d7a235860df] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:06:36.598511 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-e183bfcb-a830-43cb-8a98-93856ab0d27c tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:06:36.606484 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-e183bfcb-a830-43cb-8a98-93856ab0d27c tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/6dcfb746-60d5-48b0-ab19-2d7a235860df" status: 200 len: 1240 microversion: 2.1 time: 0.065732 Sep 16 02:06:36.607041 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 479/946] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:06:36 2022] GET /compute/v2.1/servers/6dcfb746-60d5-48b0-ab19-2d7a235860df => generated 1240 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:06:37.630393 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-51356e4d-ee0a-4191-992d-b35b44f59476 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:06:37.631055 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-51356e4d-ee0a-4191-992d-b35b44f59476 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: 6dcfb746-60d5-48b0-ab19-2d7a235860df] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:06:37.637887 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-51356e4d-ee0a-4191-992d-b35b44f59476 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:06:37.638372 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-51356e4d-ee0a-4191-992d-b35b44f59476 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:06:37.638801 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-51356e4d-ee0a-4191-992d-b35b44f59476 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:06:37.639487 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-51356e4d-ee0a-4191-992d-b35b44f59476 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:06:37.639960 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-51356e4d-ee0a-4191-992d-b35b44f59476 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:06:37.640383 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-51356e4d-ee0a-4191-992d-b35b44f59476 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:06:37.702238 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-51356e4d-ee0a-4191-992d-b35b44f59476 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:06:37.710142 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-51356e4d-ee0a-4191-992d-b35b44f59476 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/6dcfb746-60d5-48b0-ab19-2d7a235860df" status: 200 len: 1292 microversion: 2.1 time: 0.084069 Sep 16 02:06:37.710716 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 468/947] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:06:37 2022] GET /compute/v2.1/servers/6dcfb746-60d5-48b0-ab19-2d7a235860df => generated 1292 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:06:38.733779 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-8d85e495-0275-4300-86bc-9122b3f843bd tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:06:38.734318 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-8d85e495-0275-4300-86bc-9122b3f843bd tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: 6dcfb746-60d5-48b0-ab19-2d7a235860df] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:06:38.744137 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8d85e495-0275-4300-86bc-9122b3f843bd tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:06:38.744799 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8d85e495-0275-4300-86bc-9122b3f843bd tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:06:38.745607 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8d85e495-0275-4300-86bc-9122b3f843bd tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:06:38.746328 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8d85e495-0275-4300-86bc-9122b3f843bd tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:06:38.746769 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8d85e495-0275-4300-86bc-9122b3f843bd tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:06:38.747203 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8d85e495-0275-4300-86bc-9122b3f843bd tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:06:38.940466 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-8d85e495-0275-4300-86bc-9122b3f843bd tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:06:38.948710 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-8d85e495-0275-4300-86bc-9122b3f843bd tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/6dcfb746-60d5-48b0-ab19-2d7a235860df" status: 200 len: 1365 microversion: 2.1 time: 0.218913 Sep 16 02:06:38.949486 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 480/948] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:06:38 2022] GET /compute/v2.1/servers/6dcfb746-60d5-48b0-ab19-2d7a235860df => generated 1365 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:06:39.295601 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [req-33709ef1-4415-4bc7-8517-6d96455d2c6a req-52025e1f-10a0-4a24-b79a-b146901c8141 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dcfb746-60d5-48b0-ab19-2d7a235860df", "tag": "495f2eea-9dc7-490c-b725-e45ea66fa1a8"}]} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:06:39.310717 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-33709ef1-4415-4bc7-8517-6d96455d2c6a req-52025e1f-10a0-4a24-b79a-b146901c8141 service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:06:39.311559 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-33709ef1-4415-4bc7-8517-6d96455d2c6a req-52025e1f-10a0-4a24-b79a-b146901c8141 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:06:39.312676 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-33709ef1-4415-4bc7-8517-6d96455d2c6a req-52025e1f-10a0-4a24-b79a-b146901c8141 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:06:39.325567 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.compute.server_external_events [req-33709ef1-4415-4bc7-8517-6d96455d2c6a req-52025e1f-10a0-4a24-b79a-b146901c8141 service nova] Creating event network-changed:495f2eea-9dc7-490c-b725-e45ea66fa1a8 for instance 6dcfb746-60d5-48b0-ab19-2d7a235860df on hv-cinder-84914 Sep 16 02:06:39.331549 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [req-33709ef1-4415-4bc7-8517-6d96455d2c6a req-52025e1f-10a0-4a24-b79a-b146901c8141 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047044 Sep 16 02:06:39.332543 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 469/949] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:06:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:06:39.972086 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-9a409dbe-5cc7-4af0-bc78-1a8832b11885 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:06:39.972701 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-9a409dbe-5cc7-4af0-bc78-1a8832b11885 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: 6dcfb746-60d5-48b0-ab19-2d7a235860df] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:06:39.979219 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9a409dbe-5cc7-4af0-bc78-1a8832b11885 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:06:39.979703 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9a409dbe-5cc7-4af0-bc78-1a8832b11885 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:06:39.980167 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9a409dbe-5cc7-4af0-bc78-1a8832b11885 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:06:39.980856 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9a409dbe-5cc7-4af0-bc78-1a8832b11885 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:06:39.981310 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9a409dbe-5cc7-4af0-bc78-1a8832b11885 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:06:39.981750 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9a409dbe-5cc7-4af0-bc78-1a8832b11885 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:06:40.112894 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-9a409dbe-5cc7-4af0-bc78-1a8832b11885 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:06:40.120355 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-9a409dbe-5cc7-4af0-bc78-1a8832b11885 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/6dcfb746-60d5-48b0-ab19-2d7a235860df" status: 200 len: 1365 microversion: 2.1 time: 0.152147 Sep 16 02:06:40.120915 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 481/950] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:06:39 2022] GET /compute/v2.1/servers/6dcfb746-60d5-48b0-ab19-2d7a235860df => generated 1365 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:06:41.144305 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-81f496df-057c-47ec-9173-eaf177b20058 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:06:41.145003 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-81f496df-057c-47ec-9173-eaf177b20058 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: 6dcfb746-60d5-48b0-ab19-2d7a235860df] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:06:41.151252 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-81f496df-057c-47ec-9173-eaf177b20058 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:06:41.151733 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-81f496df-057c-47ec-9173-eaf177b20058 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:06:41.152199 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-81f496df-057c-47ec-9173-eaf177b20058 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:06:41.152889 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-81f496df-057c-47ec-9173-eaf177b20058 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:06:41.153344 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-81f496df-057c-47ec-9173-eaf177b20058 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:06:41.153773 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-81f496df-057c-47ec-9173-eaf177b20058 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:06:41.282404 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-81f496df-057c-47ec-9173-eaf177b20058 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:06:41.290129 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-81f496df-057c-47ec-9173-eaf177b20058 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/6dcfb746-60d5-48b0-ab19-2d7a235860df" status: 200 len: 1365 microversion: 2.1 time: 0.150492 Sep 16 02:06:41.290696 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 470/951] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:06:41 2022] GET /compute/v2.1/servers/6dcfb746-60d5-48b0-ab19-2d7a235860df => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:06:42.313484 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-3966808c-c36b-4900-9e6a-94afc9fbfc05 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:06:42.314097 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-3966808c-c36b-4900-9e6a-94afc9fbfc05 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: 6dcfb746-60d5-48b0-ab19-2d7a235860df] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:06:42.321127 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3966808c-c36b-4900-9e6a-94afc9fbfc05 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:06:42.321611 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3966808c-c36b-4900-9e6a-94afc9fbfc05 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:06:42.322053 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3966808c-c36b-4900-9e6a-94afc9fbfc05 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:06:42.322737 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3966808c-c36b-4900-9e6a-94afc9fbfc05 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:06:42.323188 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3966808c-c36b-4900-9e6a-94afc9fbfc05 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:06:42.323606 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3966808c-c36b-4900-9e6a-94afc9fbfc05 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:06:42.452007 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-3966808c-c36b-4900-9e6a-94afc9fbfc05 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:06:42.460231 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-3966808c-c36b-4900-9e6a-94afc9fbfc05 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/6dcfb746-60d5-48b0-ab19-2d7a235860df" status: 200 len: 1365 microversion: 2.1 time: 0.150616 Sep 16 02:06:42.460800 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 482/952] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:06:42 2022] GET /compute/v2.1/servers/6dcfb746-60d5-48b0-ab19-2d7a235860df => generated 1365 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:06:43.483483 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-c6a38baf-c119-41af-a61f-ecfe3d5aa353 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:06:43.484124 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-c6a38baf-c119-41af-a61f-ecfe3d5aa353 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: 6dcfb746-60d5-48b0-ab19-2d7a235860df] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:06:43.491005 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c6a38baf-c119-41af-a61f-ecfe3d5aa353 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:06:43.491479 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c6a38baf-c119-41af-a61f-ecfe3d5aa353 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:06:43.491960 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c6a38baf-c119-41af-a61f-ecfe3d5aa353 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:06:43.492663 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c6a38baf-c119-41af-a61f-ecfe3d5aa353 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:06:43.493111 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c6a38baf-c119-41af-a61f-ecfe3d5aa353 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:06:43.493532 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c6a38baf-c119-41af-a61f-ecfe3d5aa353 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:06:43.625837 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-c6a38baf-c119-41af-a61f-ecfe3d5aa353 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:06:43.633911 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-c6a38baf-c119-41af-a61f-ecfe3d5aa353 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/6dcfb746-60d5-48b0-ab19-2d7a235860df" status: 200 len: 1365 microversion: 2.1 time: 0.154238 Sep 16 02:06:43.634484 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 471/953] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:06:43 2022] GET /compute/v2.1/servers/6dcfb746-60d5-48b0-ab19-2d7a235860df => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:06:44.103871 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [req-a1e0e08f-20f3-4cbf-afa8-c657eec7dbbd req-2126d1ec-dc57-4043-b405-57c9f019e06b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dcfb746-60d5-48b0-ab19-2d7a235860df", "name": "network-vif-plugged", "status": "completed", "tag": "495f2eea-9dc7-490c-b725-e45ea66fa1a8"}]} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:06:44.114811 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-a1e0e08f-20f3-4cbf-afa8-c657eec7dbbd req-2126d1ec-dc57-4043-b405-57c9f019e06b service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:06:44.115392 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-a1e0e08f-20f3-4cbf-afa8-c657eec7dbbd req-2126d1ec-dc57-4043-b405-57c9f019e06b service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:06:44.116372 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-a1e0e08f-20f3-4cbf-afa8-c657eec7dbbd req-2126d1ec-dc57-4043-b405-57c9f019e06b service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:06:44.127437 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.compute.server_external_events [req-a1e0e08f-20f3-4cbf-afa8-c657eec7dbbd req-2126d1ec-dc57-4043-b405-57c9f019e06b service nova] Creating event network-vif-plugged:495f2eea-9dc7-490c-b725-e45ea66fa1a8 for instance 6dcfb746-60d5-48b0-ab19-2d7a235860df on hv-cinder-84914 Sep 16 02:06:44.132747 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [req-a1e0e08f-20f3-4cbf-afa8-c657eec7dbbd req-2126d1ec-dc57-4043-b405-57c9f019e06b service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033575 Sep 16 02:06:44.133325 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 483/954] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:06:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:06:44.656865 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-aa39aa49-c494-4955-ac0d-03fd62d95621 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:06:44.657593 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-aa39aa49-c494-4955-ac0d-03fd62d95621 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: 6dcfb746-60d5-48b0-ab19-2d7a235860df] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:06:44.664609 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-aa39aa49-c494-4955-ac0d-03fd62d95621 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:06:44.665087 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-aa39aa49-c494-4955-ac0d-03fd62d95621 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:06:44.665515 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-aa39aa49-c494-4955-ac0d-03fd62d95621 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:06:44.666191 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-aa39aa49-c494-4955-ac0d-03fd62d95621 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:06:44.666637 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-aa39aa49-c494-4955-ac0d-03fd62d95621 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:06:44.667054 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-aa39aa49-c494-4955-ac0d-03fd62d95621 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:06:44.792780 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-aa39aa49-c494-4955-ac0d-03fd62d95621 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:06:44.800485 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-aa39aa49-c494-4955-ac0d-03fd62d95621 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/6dcfb746-60d5-48b0-ab19-2d7a235860df" status: 200 len: 1365 microversion: 2.1 time: 0.147549 Sep 16 02:06:44.801057 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 472/955] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:06:44 2022] GET /compute/v2.1/servers/6dcfb746-60d5-48b0-ab19-2d7a235860df => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:06:45.831105 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-85aedcb1-b283-4510-8505-9a1e94677eac tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:06:45.831808 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-85aedcb1-b283-4510-8505-9a1e94677eac tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: 6dcfb746-60d5-48b0-ab19-2d7a235860df] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:06:45.839367 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-85aedcb1-b283-4510-8505-9a1e94677eac tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:06:45.839855 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-85aedcb1-b283-4510-8505-9a1e94677eac tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:06:45.840337 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-85aedcb1-b283-4510-8505-9a1e94677eac tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:06:45.841220 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-85aedcb1-b283-4510-8505-9a1e94677eac tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:06:45.841676 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-85aedcb1-b283-4510-8505-9a1e94677eac tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:06:45.842102 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-85aedcb1-b283-4510-8505-9a1e94677eac tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:06:45.971112 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-85aedcb1-b283-4510-8505-9a1e94677eac tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:06:45.979095 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-85aedcb1-b283-4510-8505-9a1e94677eac tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/6dcfb746-60d5-48b0-ab19-2d7a235860df" status: 200 len: 1554 microversion: 2.1 time: 0.152166 Sep 16 02:06:45.979655 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 484/956] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:06:45 2022] GET /compute/v2.1/servers/6dcfb746-60d5-48b0-ab19-2d7a235860df => generated 1554 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:06:46.002942 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-1dbf1454-45a0-4869-bb8e-87502b290066 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:06:46.003487 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-1dbf1454-45a0-4869-bb8e-87502b290066 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: 6dcfb746-60d5-48b0-ab19-2d7a235860df] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:06:46.011102 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1dbf1454-45a0-4869-bb8e-87502b290066 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:06:46.011102 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1dbf1454-45a0-4869-bb8e-87502b290066 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:06:46.011502 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1dbf1454-45a0-4869-bb8e-87502b290066 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:06:46.012253 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1dbf1454-45a0-4869-bb8e-87502b290066 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:06:46.012723 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1dbf1454-45a0-4869-bb8e-87502b290066 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:06:46.013141 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1dbf1454-45a0-4869-bb8e-87502b290066 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:06:46.089883 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-1dbf1454-45a0-4869-bb8e-87502b290066 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/6dcfb746-60d5-48b0-ab19-2d7a235860df/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091166 Sep 16 02:06:46.090513 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 473/957] 10.222.0.42 () {58 vars in 1275 bytes} [Fri Sep 16 02:06:45 2022] GET /compute/v2.1/servers/6dcfb746-60d5-48b0-ab19-2d7a235860df/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:06:47.167861 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell0:SELECT=6 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:06:47.222686 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [req-c9c6a897-aef1-4229-9acb-0d704eed033f req-75bbb01c-d566-430e-95e5-f88adf06c4c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6dcfb746-60d5-48b0-ab19-2d7a235860df", "tag": "495f2eea-9dc7-490c-b725-e45ea66fa1a8"}]} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:06:47.232759 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-c9c6a897-aef1-4229-9acb-0d704eed033f req-75bbb01c-d566-430e-95e5-f88adf06c4c6 service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:06:47.233352 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-c9c6a897-aef1-4229-9acb-0d704eed033f req-75bbb01c-d566-430e-95e5-f88adf06c4c6 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:06:47.233788 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-c9c6a897-aef1-4229-9acb-0d704eed033f req-75bbb01c-d566-430e-95e5-f88adf06c4c6 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:06:47.244866 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.compute.server_external_events [req-c9c6a897-aef1-4229-9acb-0d704eed033f req-75bbb01c-d566-430e-95e5-f88adf06c4c6 service nova] Creating event network-changed:495f2eea-9dc7-490c-b725-e45ea66fa1a8 for instance 6dcfb746-60d5-48b0-ab19-2d7a235860df on hv-cinder-84914 Sep 16 02:06:47.250234 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [req-c9c6a897-aef1-4229-9acb-0d704eed033f req-75bbb01c-d566-430e-95e5-f88adf06c4c6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.088257 Sep 16 02:06:47.250845 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 485/958] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:06:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:07:36.109827 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell0:SELECT=2 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:07:36.110592 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell0:SELECT=6 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:07:36.112021 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_api:SELECT=43,nova_api:INSERT=3 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:07:36.112693 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:07:36.117809 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-86340386-dadf-4235-af8c-2e2502a750af tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-668937438"}} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:07:36.118338 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-86340386-dadf-4235-af8c-2e2502a750af tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] [instance: 8351c196-00ce-4ff2-8c6d-b2464bfcf401] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:07:36.127030 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-86340386-dadf-4235-af8c-2e2502a750af tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:07:36.127585 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-86340386-dadf-4235-af8c-2e2502a750af tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:07:36.128045 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-86340386-dadf-4235-af8c-2e2502a750af tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:07:36.128734 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-86340386-dadf-4235-af8c-2e2502a750af tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:07:36.129195 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-86340386-dadf-4235-af8c-2e2502a750af tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:07:36.129610 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-86340386-dadf-4235-af8c-2e2502a750af tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:07:36.259498 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.network.security_group_api [None req-86340386-dadf-4235-af8c-2e2502a750af tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Removing security group 8a773f28-2b0d-4a48-8338-85d0f80a6d4d from port 98214adc-c813-4c74-b55b-97383bfc06f7 Sep 16 02:07:36.589387 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-86340386-dadf-4235-af8c-2e2502a750af tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] 10.222.0.42 "POST /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401/action" status: 202 len: 0 microversion: 2.1 time: 0.480251 Sep 16 02:07:36.590031 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 474/959] 10.222.0.42 () {60 vars in 1278 bytes} [Fri Sep 16 02:07:36 2022] POST /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401/action => generated 0 bytes in 482 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 02:07:36.601238 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [req-8a438ab5-685f-4e13-bb3b-a3287e97958b req-198a2e50-73be-43b6-9c23-74d2bf557ae5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8351c196-00ce-4ff2-8c6d-b2464bfcf401", "tag": "98214adc-c813-4c74-b55b-97383bfc06f7"}]} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:07:36.607239 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_api:SELECT=39,nova_api:INSERT=1 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:07:36.608508 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:07:36.624327 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-8a438ab5-685f-4e13-bb3b-a3287e97958b req-198a2e50-73be-43b6-9c23-74d2bf557ae5 service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:07:36.636398 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-8a438ab5-685f-4e13-bb3b-a3287e97958b req-198a2e50-73be-43b6-9c23-74d2bf557ae5 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:07:36.636969 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-8a438ab5-685f-4e13-bb3b-a3287e97958b req-198a2e50-73be-43b6-9c23-74d2bf557ae5 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:07:36.661125 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.compute.server_external_events [req-8a438ab5-685f-4e13-bb3b-a3287e97958b req-198a2e50-73be-43b6-9c23-74d2bf557ae5 service nova] Creating event network-changed:98214adc-c813-4c74-b55b-97383bfc06f7 for instance 8351c196-00ce-4ff2-8c6d-b2464bfcf401 on hv-cinder-84914 Sep 16 02:07:36.676499 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [req-8a438ab5-685f-4e13-bb3b-a3287e97958b req-198a2e50-73be-43b6-9c23-74d2bf557ae5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.081856 Sep 16 02:07:36.677311 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 486/960] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:07:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 02:07:37.733606 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-e14989cd-76ba-4fbd-ba8b-20c4ca631874 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:07:37.734139 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-e14989cd-76ba-4fbd-ba8b-20c4ca631874 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] [instance: 8351c196-00ce-4ff2-8c6d-b2464bfcf401] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:07:37.741026 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e14989cd-76ba-4fbd-ba8b-20c4ca631874 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:07:37.741512 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e14989cd-76ba-4fbd-ba8b-20c4ca631874 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:07:37.741952 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e14989cd-76ba-4fbd-ba8b-20c4ca631874 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:07:37.742644 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e14989cd-76ba-4fbd-ba8b-20c4ca631874 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:07:37.743102 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e14989cd-76ba-4fbd-ba8b-20c4ca631874 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:07:37.743536 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e14989cd-76ba-4fbd-ba8b-20c4ca631874 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:07:37.829289 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.objects.instance [None req-e14989cd-76ba-4fbd-ba8b-20c4ca631874 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lazy-loading 'services' on Instance uuid 8351c196-00ce-4ff2-8c6d-b2464bfcf401 {{(pid=120440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 02:07:37.903065 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-e14989cd-76ba-4fbd-ba8b-20c4ca631874 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401/os-volume_attachments/09d585d8-9c75-4ff4-b9a4-cb4e3bd9547b" status: 202 len: 0 microversion: 2.1 time: 0.173798 Sep 16 02:07:37.903789 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 475/961] 10.222.0.42 () {58 vars in 1416 bytes} [Fri Sep 16 02:07:37 2022] DELETE /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401/os-volume_attachments/09d585d8-9c75-4ff4-b9a4-cb4e3bd9547b => generated 0 bytes in 175 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 02:07:37.914362 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-da8af1fd-e797-4156-b4a0-7464a66125a4 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:07:37.917287 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-da8af1fd-e797-4156-b4a0-7464a66125a4 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] [instance: 8351c196-00ce-4ff2-8c6d-b2464bfcf401] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:07:37.925309 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-da8af1fd-e797-4156-b4a0-7464a66125a4 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:07:37.925872 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-da8af1fd-e797-4156-b4a0-7464a66125a4 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:07:37.927341 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-da8af1fd-e797-4156-b4a0-7464a66125a4 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:07:37.928076 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-da8af1fd-e797-4156-b4a0-7464a66125a4 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:07:37.928521 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-da8af1fd-e797-4156-b4a0-7464a66125a4 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:07:37.928940 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-da8af1fd-e797-4156-b4a0-7464a66125a4 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:07:37.962107 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-da8af1fd-e797-4156-b4a0-7464a66125a4 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] 10.222.0.42 "GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053705 Sep 16 02:07:37.962596 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 487/962] 10.222.0.42 () {58 vars in 1302 bytes} [Fri Sep 16 02:07:37 2022] GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401/os-volume_attachments => generated 197 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:07:38.835486 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [req-54248464-1bff-4975-8333-7730cd6c46d5 req-bed44e84-bb91-4af5-a06a-1d4c148e9151 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8351c196-00ce-4ff2-8c6d-b2464bfcf401", "tag": "98214adc-c813-4c74-b55b-97383bfc06f7"}]} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:07:38.845037 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-54248464-1bff-4975-8333-7730cd6c46d5 req-bed44e84-bb91-4af5-a06a-1d4c148e9151 service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:07:38.845515 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-54248464-1bff-4975-8333-7730cd6c46d5 req-bed44e84-bb91-4af5-a06a-1d4c148e9151 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:07:38.845947 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-54248464-1bff-4975-8333-7730cd6c46d5 req-bed44e84-bb91-4af5-a06a-1d4c148e9151 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:07:38.857210 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.compute.server_external_events [req-54248464-1bff-4975-8333-7730cd6c46d5 req-bed44e84-bb91-4af5-a06a-1d4c148e9151 service nova] Creating event network-changed:98214adc-c813-4c74-b55b-97383bfc06f7 for instance 8351c196-00ce-4ff2-8c6d-b2464bfcf401 on hv-cinder-84914 Sep 16 02:07:38.861962 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [req-54248464-1bff-4975-8333-7730cd6c46d5 req-bed44e84-bb91-4af5-a06a-1d4c148e9151 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031504 Sep 16 02:07:38.862532 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 476/963] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:07:38.974556 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-5ec59a17-79a8-4719-8fa6-2075801da77a tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:07:38.976777 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-5ec59a17-79a8-4719-8fa6-2075801da77a tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] [instance: 8351c196-00ce-4ff2-8c6d-b2464bfcf401] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:07:38.984773 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5ec59a17-79a8-4719-8fa6-2075801da77a tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:07:38.985379 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5ec59a17-79a8-4719-8fa6-2075801da77a tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:07:38.985886 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5ec59a17-79a8-4719-8fa6-2075801da77a tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:07:38.986853 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5ec59a17-79a8-4719-8fa6-2075801da77a tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:07:38.987447 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5ec59a17-79a8-4719-8fa6-2075801da77a tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:07:38.987929 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5ec59a17-79a8-4719-8fa6-2075801da77a tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:07:39.023628 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-5ec59a17-79a8-4719-8fa6-2075801da77a tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] 10.222.0.42 "GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.052985 Sep 16 02:07:39.024280 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 488/964] 10.222.0.42 () {58 vars in 1302 bytes} [Fri Sep 16 02:07:38 2022] GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401/os-volume_attachments => generated 25 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 02:07:39.039667 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-7eeb4920-eeeb-4b49-95e1-1985e4cc42cc tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:07:39.040312 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-7eeb4920-eeeb-4b49-95e1-1985e4cc42cc tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] [instance: 8351c196-00ce-4ff2-8c6d-b2464bfcf401] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:07:39.047231 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7eeb4920-eeeb-4b49-95e1-1985e4cc42cc tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:07:39.047736 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7eeb4920-eeeb-4b49-95e1-1985e4cc42cc tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:07:39.048317 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7eeb4920-eeeb-4b49-95e1-1985e4cc42cc tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:07:39.049115 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7eeb4920-eeeb-4b49-95e1-1985e4cc42cc tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:07:39.049610 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7eeb4920-eeeb-4b49-95e1-1985e4cc42cc tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:07:39.050115 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7eeb4920-eeeb-4b49-95e1-1985e4cc42cc tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:07:39.133408 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.wsgi [None req-7eeb4920-eeeb-4b49-95e1-1985e4cc42cc tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] HTTP exception thrown: Instance 8351c196-00ce-4ff2-8c6d-b2464bfcf401 is not attached to volume 09d585d8-9c75-4ff4-b9a4-cb4e3bd9547b Sep 16 02:07:39.135834 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-7eeb4920-eeeb-4b49-95e1-1985e4cc42cc tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Request method failure captured: Sep 16 02:07:39.135834 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: request: DELETE /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401/os-volume_attachments/09d585d8-9c75-4ff4-b9a4-cb4e3bd9547b HTTP/1.1 Sep 16 02:07:39.135834 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept: application/json Sep 16 02:07:39.135834 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept-Encoding: identity Sep 16 02:07:39.135834 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Connection: close Sep 16 02:07:39.135834 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Length: 0 Sep 16 02:07:39.135834 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Type: application/json Sep 16 02:07:39.135834 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Host: 10.222.0.42 Sep 16 02:07:39.135834 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Openstack-System-Scope: None Sep 16 02:07:39.135834 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: User-Agent: python-urllib3/1.26.12 Sep 16 02:07:39.135834 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Auth-Token: gAAAAABjI9miFrlzcLn7jsKDPll0o8k0M8yM0H1JBiwdbuWcrQ_V_Lld9iRplcMFRATmNJMBbBvZdfQpYh6fEN8o6cpKSja35H0g21KUAU0ma12buJOJzeKK6hc_rGf0HpBje1jXkw9tBQv0YTHvhXkdEdfuD54XYl3PC1FDQLTe4Z5M1YbdW0c Sep 16 02:07:39.135834 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Id: None Sep 16 02:07:39.135834 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Name: None Sep 16 02:07:39.135834 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Identity-Status: Confirmed Sep 16 02:07:39.135834 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Is-Admin-Project: True Sep 16 02:07:39.135834 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Id: default Sep 16 02:07:39.135834 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Name: Default Sep 16 02:07:39.135834 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Id: 5318d2681e9d4fd2adc29977165e0a9b Sep 16 02:07:39.135834 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Name: tempest-TestMinimumBasicScenario-1822998230 Sep 16 02:07:39.135834 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Role: member,reader Sep 16 02:07:39.135834 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Roles: member,reader Sep 16 02:07:39.137585 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5318d2681e9d4fd2adc29977165e0a9b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5318d2681e9d4fd2adc29977165e0a9b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5318d2681e9d4fd2adc29977165e0a9b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5318d2681e9d4fd2adc29977165e0a9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 02:07:39.137585 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant: tempest-TestMinimumBasicScenario-1822998230 Sep 16 02:07:39.137585 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Id: 5318d2681e9d4fd2adc29977165e0a9b Sep 16 02:07:39.137585 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1822998230 Sep 16 02:07:39.137585 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User: tempest-TestMinimumBasicScenario-1822998230-project Sep 16 02:07:39.137585 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Id: default Sep 16 02:07:39.137585 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Name: Default Sep 16 02:07:39.137585 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Id: e961b9e63ece47e8934b7e4c7b5c46ff Sep 16 02:07:39.137585 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Name: tempest-TestMinimumBasicScenario-1822998230-project Sep 16 02:07:39.137585 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: method: > Sep 16 02:07:39.137585 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: exception: Instance 8351c196-00ce-4ff2-8c6d-b2464bfcf401 is not attached to volume 09d585d8-9c75-4ff4-b9a4-cb4e3bd9547b Sep 16 02:07:39.142125 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: action_args: {'server_id': '8351c196-00ce-4ff2-8c6d-b2464bfcf401', 'id': '09d585d8-9c75-4ff4-b9a4-cb4e3bd9547b'} Sep 16 02:07:39.142125 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 02:07:39.142125 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:07:39.142125 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 16 02:07:39.142125 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 16 02:07:39.142125 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 02:07:39.142125 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 02:07:39.142125 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 16 02:07:39.142125 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 16 02:07:39.142125 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 09d585d8-9c75-4ff4-b9a4-cb4e3bd9547b. Sep 16 02:07:39.142125 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:07:39.142125 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:07:39.142125 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:07:39.142125 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:07:39.142125 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:07:39.142125 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:07:39.142125 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 02:07:39.142125 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 02:07:39.142125 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 02:07:39.143644 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 02:07:39.143644 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 16 02:07:39.143644 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 16 02:07:39.143644 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8351c196-00ce-4ff2-8c6d-b2464bfcf401 is not attached to volume 09d585d8-9c75-4ff4-b9a4-cb4e3bd9547b Sep 16 02:07:39.143644 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:07:39.143644 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:07:39.143644 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:07:39.143644 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:07:39.143644 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:07:39.143644 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:07:39.143644 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 02:07:39.143644 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 02:07:39.143644 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8351c196-00ce-4ff2-8c6d-b2464bfcf401 is not attached to volume 09d585d8-9c75-4ff4-b9a4-cb4e3bd9547b Sep 16 02:07:39.143644 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:07:39.143644 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-7eeb4920-eeeb-4b49-95e1-1985e4cc42cc tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Returning 404 to user: Instance 8351c196-00ce-4ff2-8c6d-b2464bfcf401 is not attached to volume 09d585d8-9c75-4ff4-b9a4-cb4e3bd9547b {{(pid=120440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 02:07:39.145092 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-7eeb4920-eeeb-4b49-95e1-1985e4cc42cc tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401/os-volume_attachments/09d585d8-9c75-4ff4-b9a4-cb4e3bd9547b" status: 404 len: 154 microversion: 2.1 time: 0.102931 Sep 16 02:07:39.145092 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 477/965] 10.222.0.42 () {58 vars in 1416 bytes} [Fri Sep 16 02:07:39 2022] DELETE /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401/os-volume_attachments/09d585d8-9c75-4ff4-b9a4-cb4e3bd9547b => generated 154 bytes in 105 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 02:07:40.286273 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-acdbabaf-db25-4f3f-914d-de4109155c8e tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:07:40.286739 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-acdbabaf-db25-4f3f-914d-de4109155c8e tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] [instance: 8351c196-00ce-4ff2-8c6d-b2464bfcf401] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:07:40.292997 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-acdbabaf-db25-4f3f-914d-de4109155c8e tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:07:40.293476 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-acdbabaf-db25-4f3f-914d-de4109155c8e tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:07:40.293905 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-acdbabaf-db25-4f3f-914d-de4109155c8e tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:07:40.294578 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-acdbabaf-db25-4f3f-914d-de4109155c8e tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:07:40.295022 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-acdbabaf-db25-4f3f-914d-de4109155c8e tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:07:40.295436 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-acdbabaf-db25-4f3f-914d-de4109155c8e tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:07:40.322510 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-acdbabaf-db25-4f3f-914d-de4109155c8e tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] [instance: 8351c196-00ce-4ff2-8c6d-b2464bfcf401] Going to try to terminate instance {{(pid=120441) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 02:07:40.395602 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-acdbabaf-db25-4f3f-914d-de4109155c8e tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] 10.222.0.42 "DELETE /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401" status: 204 len: 0 microversion: 2.1 time: 0.112405 Sep 16 02:07:40.396264 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 489/966] 10.222.0.42 () {58 vars in 1239 bytes} [Fri Sep 16 02:07:40 2022] DELETE /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401 => generated 0 bytes in 114 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 02:07:40.405025 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-31b16e61-59be-4834-8039-eb82dcd04009 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:07:40.405637 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-31b16e61-59be-4834-8039-eb82dcd04009 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] [instance: 8351c196-00ce-4ff2-8c6d-b2464bfcf401] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:07:40.413213 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-31b16e61-59be-4834-8039-eb82dcd04009 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:07:40.413697 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-31b16e61-59be-4834-8039-eb82dcd04009 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:07:40.414129 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-31b16e61-59be-4834-8039-eb82dcd04009 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:07:40.414816 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-31b16e61-59be-4834-8039-eb82dcd04009 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:07:40.415264 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-31b16e61-59be-4834-8039-eb82dcd04009 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:07:40.415689 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-31b16e61-59be-4834-8039-eb82dcd04009 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:07:40.549489 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-31b16e61-59be-4834-8039-eb82dcd04009 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961b9e63ece47e8934b7e4c7b5c46ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5318d2681e9d4fd2adc29977165e0a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:07:40.557550 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-31b16e61-59be-4834-8039-eb82dcd04009 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] 10.222.0.42 "GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401" status: 200 len: 1554 microversion: 2.1 time: 0.156878 Sep 16 02:07:40.558112 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 478/967] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:07:40 2022] GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:07:41.581403 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-cd952f19-7ece-408e-8f91-2dc1dcf4ee75 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:07:41.582176 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-cd952f19-7ece-408e-8f91-2dc1dcf4ee75 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] [instance: 8351c196-00ce-4ff2-8c6d-b2464bfcf401] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:07:41.588468 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-cd952f19-7ece-408e-8f91-2dc1dcf4ee75 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:07:41.588945 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-cd952f19-7ece-408e-8f91-2dc1dcf4ee75 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:07:41.589373 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-cd952f19-7ece-408e-8f91-2dc1dcf4ee75 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:07:41.590045 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-cd952f19-7ece-408e-8f91-2dc1dcf4ee75 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:07:41.590490 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-cd952f19-7ece-408e-8f91-2dc1dcf4ee75 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:07:41.590927 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-cd952f19-7ece-408e-8f91-2dc1dcf4ee75 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:07:41.719321 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-cd952f19-7ece-408e-8f91-2dc1dcf4ee75 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961b9e63ece47e8934b7e4c7b5c46ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5318d2681e9d4fd2adc29977165e0a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:07:41.727707 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-cd952f19-7ece-408e-8f91-2dc1dcf4ee75 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] 10.222.0.42 "GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401" status: 200 len: 1554 microversion: 2.1 time: 0.150567 Sep 16 02:07:41.728313 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 490/968] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:07:41 2022] GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401 => generated 1554 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:07:42.752592 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-473421a6-1edd-409f-b90f-97f8d5bed22d tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:07:42.753334 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-473421a6-1edd-409f-b90f-97f8d5bed22d tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] [instance: 8351c196-00ce-4ff2-8c6d-b2464bfcf401] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:07:42.759796 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-473421a6-1edd-409f-b90f-97f8d5bed22d tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:07:42.760386 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-473421a6-1edd-409f-b90f-97f8d5bed22d tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:07:42.760822 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-473421a6-1edd-409f-b90f-97f8d5bed22d tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:07:42.761514 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-473421a6-1edd-409f-b90f-97f8d5bed22d tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:07:42.761969 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-473421a6-1edd-409f-b90f-97f8d5bed22d tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:07:42.762395 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-473421a6-1edd-409f-b90f-97f8d5bed22d tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:07:42.895672 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-473421a6-1edd-409f-b90f-97f8d5bed22d tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e961b9e63ece47e8934b7e4c7b5c46ff', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5318d2681e9d4fd2adc29977165e0a9b', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:07:42.907622 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-473421a6-1edd-409f-b90f-97f8d5bed22d tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] 10.222.0.42 "GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401" status: 200 len: 1554 microversion: 2.1 time: 0.159161 Sep 16 02:07:42.909076 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 479/969] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:07:42 2022] GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401 => generated 1554 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:07:42.956523 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [req-c4ca9b9f-d251-45d7-b44d-d8584217b8d1 req-b77a1b0d-3f40-41b3-9197-b211ac596275 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8351c196-00ce-4ff2-8c6d-b2464bfcf401", "name": "network-vif-deleted", "tag": "98214adc-c813-4c74-b55b-97383bfc06f7"}]} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:07:42.967471 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-c4ca9b9f-d251-45d7-b44d-d8584217b8d1 req-b77a1b0d-3f40-41b3-9197-b211ac596275 service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:07:42.967954 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-c4ca9b9f-d251-45d7-b44d-d8584217b8d1 req-b77a1b0d-3f40-41b3-9197-b211ac596275 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:07:42.968396 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-c4ca9b9f-d251-45d7-b44d-d8584217b8d1 req-b77a1b0d-3f40-41b3-9197-b211ac596275 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:07:42.979732 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.compute.server_external_events [req-c4ca9b9f-d251-45d7-b44d-d8584217b8d1 req-b77a1b0d-3f40-41b3-9197-b211ac596275 service nova] Creating event network-vif-deleted:98214adc-c813-4c74-b55b-97383bfc06f7 for instance 8351c196-00ce-4ff2-8c6d-b2464bfcf401 on hv-cinder-84914 Sep 16 02:07:42.984906 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [req-c4ca9b9f-d251-45d7-b44d-d8584217b8d1 req-b77a1b0d-3f40-41b3-9197-b211ac596275 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032030 Sep 16 02:07:42.985522 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 491/970] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:07:42 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:07:43.932854 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-8c4f9664-7913-455e-866c-7a8b215b58e2 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:07:43.933427 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-8c4f9664-7913-455e-866c-7a8b215b58e2 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] [instance: 8351c196-00ce-4ff2-8c6d-b2464bfcf401] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:07:43.939870 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8c4f9664-7913-455e-866c-7a8b215b58e2 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:07:43.940394 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8c4f9664-7913-455e-866c-7a8b215b58e2 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:07:43.940837 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8c4f9664-7913-455e-866c-7a8b215b58e2 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:07:43.941759 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8c4f9664-7913-455e-866c-7a8b215b58e2 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:07:43.942224 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8c4f9664-7913-455e-866c-7a8b215b58e2 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:07:43.942657 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8c4f9664-7913-455e-866c-7a8b215b58e2 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:07:43.956069 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.wsgi [None req-8c4f9664-7913-455e-866c-7a8b215b58e2 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] HTTP exception thrown: Instance 8351c196-00ce-4ff2-8c6d-b2464bfcf401 could not be found. Sep 16 02:07:43.958094 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-8c4f9664-7913-455e-866c-7a8b215b58e2 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Request method failure captured: Sep 16 02:07:43.958094 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: request: GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401 HTTP/1.1 Sep 16 02:07:43.958094 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept: application/json Sep 16 02:07:43.958094 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept-Encoding: identity Sep 16 02:07:43.958094 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Connection: close Sep 16 02:07:43.958094 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Length: 0 Sep 16 02:07:43.958094 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Type: application/json Sep 16 02:07:43.958094 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Host: 10.222.0.42 Sep 16 02:07:43.958094 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Openstack-System-Scope: None Sep 16 02:07:43.958094 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: User-Agent: python-urllib3/1.26.12 Sep 16 02:07:43.958094 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Auth-Token: gAAAAABjI9miFrlzcLn7jsKDPll0o8k0M8yM0H1JBiwdbuWcrQ_V_Lld9iRplcMFRATmNJMBbBvZdfQpYh6fEN8o6cpKSja35H0g21KUAU0ma12buJOJzeKK6hc_rGf0HpBje1jXkw9tBQv0YTHvhXkdEdfuD54XYl3PC1FDQLTe4Z5M1YbdW0c Sep 16 02:07:43.958094 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Id: None Sep 16 02:07:43.958094 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Name: None Sep 16 02:07:43.958094 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Identity-Status: Confirmed Sep 16 02:07:43.958094 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Is-Admin-Project: True Sep 16 02:07:43.958094 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Id: default Sep 16 02:07:43.958094 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Name: Default Sep 16 02:07:43.958094 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Id: 5318d2681e9d4fd2adc29977165e0a9b Sep 16 02:07:43.958094 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Name: tempest-TestMinimumBasicScenario-1822998230 Sep 16 02:07:43.958094 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Role: member,reader Sep 16 02:07:43.958094 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Roles: member,reader Sep 16 02:07:43.959662 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/5318d2681e9d4fd2adc29977165e0a9b"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5318d2681e9d4fd2adc29977165e0a9b"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_5318d2681e9d4fd2adc29977165e0a9b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/5318d2681e9d4fd2adc29977165e0a9b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 02:07:43.959662 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant: tempest-TestMinimumBasicScenario-1822998230 Sep 16 02:07:43.959662 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Id: 5318d2681e9d4fd2adc29977165e0a9b Sep 16 02:07:43.959662 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Name: tempest-TestMinimumBasicScenario-1822998230 Sep 16 02:07:43.959662 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User: tempest-TestMinimumBasicScenario-1822998230-project Sep 16 02:07:43.959662 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Id: default Sep 16 02:07:43.959662 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Name: Default Sep 16 02:07:43.959662 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Id: e961b9e63ece47e8934b7e4c7b5c46ff Sep 16 02:07:43.959662 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Name: tempest-TestMinimumBasicScenario-1822998230-project Sep 16 02:07:43.959662 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: method: > Sep 16 02:07:43.959662 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: exception: Instance 8351c196-00ce-4ff2-8c6d-b2464bfcf401 could not be found. Sep 16 02:07:43.959662 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: action_args: {'id': '8351c196-00ce-4ff2-8c6d-b2464bfcf401'} Sep 16 02:07:43.960627 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 02:07:43.960627 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:07:43.960627 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 02:07:43.960627 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 02:07:43.960627 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 02:07:43.960627 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 02:07:43.960627 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 02:07:43.960627 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 02:07:43.960627 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 02:07:43.960627 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 02:07:43.960627 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8351c196-00ce-4ff2-8c6d-b2464bfcf401 could not be found. Sep 16 02:07:43.960627 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:07:43.960627 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:07:43.960627 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:07:43.960627 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:07:43.960627 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:07:43.960627 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:07:43.960627 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 02:07:43.960627 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 02:07:43.960627 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 02:07:43.961922 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 02:07:43.961922 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 02:07:43.961922 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 02:07:43.961922 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 02:07:43.961922 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 02:07:43.961922 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 02:07:43.961922 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 02:07:43.961922 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8351c196-00ce-4ff2-8c6d-b2464bfcf401 could not be found. Sep 16 02:07:43.961922 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:07:43.961922 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:07:43.961922 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:07:43.961922 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:07:43.961922 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:07:43.961922 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:07:43.961922 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 02:07:43.961922 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 02:07:43.961922 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8351c196-00ce-4ff2-8c6d-b2464bfcf401 could not be found. Sep 16 02:07:43.961922 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:07:43.963245 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-8c4f9664-7913-455e-866c-7a8b215b58e2 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Returning 404 to user: Instance 8351c196-00ce-4ff2-8c6d-b2464bfcf401 could not be found. {{(pid=120440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 02:07:43.963245 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-8c4f9664-7913-455e-866c-7a8b215b58e2 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] 10.222.0.42 "GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401" status: 404 len: 111 microversion: 2.1 time: 0.030689 Sep 16 02:07:43.963245 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 480/971] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:07:43 2022] GET /compute/v2.1/servers/8351c196-00ce-4ff2-8c6d-b2464bfcf401 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 02:07:43.969520 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-5e1ab251-c70e-4a6b-b2fa-fa302515de61 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] Calling method '.version_select at 0x7fae32b39280>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:07:43.989898 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-5e1ab251-c70e-4a6b-b2fa-fa302515de61 tempest-TestMinimumBasicScenario-1822998230 tempest-TestMinimumBasicScenario-1822998230-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-993447048" status: 202 len: 0 microversion: 2.1 time: 0.024885 Sep 16 02:07:43.990553 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 492/972] 10.222.0.42 () {58 vars in 1269 bytes} [Fri Sep 16 02:07:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-993447048 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 02:08:01.124928 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_api:SELECT=14 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:08:01.125655 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell1:SELECT=35,nova_cell1:INSERT=1 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:08:01.126679 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 02:08:01.126863 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Fri Sep 16 02:08:01 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-keypairs (ip 10.222.0.42) !!! Sep 16 02:08:01.299859 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-3632d482-143a-4f17-9942-c8f28b550612 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Action: 'create', calling method: .version_select at 0x7fae32ba8280>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1042516554", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFcLxIi/eaScFDku10kTtcJNoclPPcvLaSivvYTuoyhEWZNoXsYILUNLetGRFOoaxumJRYU2fuX2W8m9ARTHu5DqDZzlPPdmTPFOztFPJeA7JE47brrqfI/DqrQFUm+ToQ=="}} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:08:01.316773 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.quota [None req-3632d482-143a-4f17-9942-c8f28b550612 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Getting quotas for project 9cfcd2376b1c4398befa49b423aaae26. Resources: {'key_pairs'} {{(pid=120440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 02:08:01.320823 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.quota [None req-3632d482-143a-4f17-9942-c8f28b550612 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Getting quotas for user 772659a1932d45dea2c5120c4497314b and project 9cfcd2376b1c4398befa49b423aaae26. Resources: {'key_pairs'} {{(pid=120440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 02:08:01.346774 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-3632d482-143a-4f17-9942-c8f28b550612 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.227130 Sep 16 02:08:01.348157 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 481/973] 10.222.0.42 () {60 vars in 1159 bytes} [Fri Sep 16 02:08:01 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:08:01.783138 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell1:SELECT=36,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:08:01.784231 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_api:SELECT=20,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:08:01.789255 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-4a0b17f5-8e58-4d33-82d4-4b6a3489baa9 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:08:01.789920 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-4a0b17f5-8e58-4d33-82d4-4b6a3489baa9 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: 6dcfb746-60d5-48b0-ab19-2d7a235860df] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:08:01.805628 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4a0b17f5-8e58-4d33-82d4-4b6a3489baa9 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:01.806393 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4a0b17f5-8e58-4d33-82d4-4b6a3489baa9 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:01.806890 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4a0b17f5-8e58-4d33-82d4-4b6a3489baa9 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:01.807779 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4a0b17f5-8e58-4d33-82d4-4b6a3489baa9 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:01.808268 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4a0b17f5-8e58-4d33-82d4-4b6a3489baa9 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:01.808696 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4a0b17f5-8e58-4d33-82d4-4b6a3489baa9 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:01.836325 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-4a0b17f5-8e58-4d33-82d4-4b6a3489baa9 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/6dcfb746-60d5-48b0-ab19-2d7a235860df/ips" status: 200 len: 148 microversion: 2.1 time: 0.054583 Sep 16 02:08:01.837571 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 493/974] 10.222.0.42 () {58 vars in 1248 bytes} [Fri Sep 16 02:08:01 2022] GET /compute/v2.1/servers/6dcfb746-60d5-48b0-ab19-2d7a235860df/ips => generated 148 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:08:01.851587 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-400aa588-96b0-46ec-a4b0-9b2f9f5ad374 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6606f59b-cb62-4b63-a0b8-409ca6996e63"}} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:08:01.855715 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-400aa588-96b0-46ec-a4b0-9b2f9f5ad374 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: 6dcfb746-60d5-48b0-ab19-2d7a235860df] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:08:01.863407 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-400aa588-96b0-46ec-a4b0-9b2f9f5ad374 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:01.864238 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-400aa588-96b0-46ec-a4b0-9b2f9f5ad374 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:01.864866 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-400aa588-96b0-46ec-a4b0-9b2f9f5ad374 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:01.865751 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-400aa588-96b0-46ec-a4b0-9b2f9f5ad374 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:01.866586 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-400aa588-96b0-46ec-a4b0-9b2f9f5ad374 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:01.867020 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-400aa588-96b0-46ec-a4b0-9b2f9f5ad374 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:01.953100 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.wsgi [None req-400aa588-96b0-46ec-a4b0-9b2f9f5ad374 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] HTTP exception thrown: Invalid volume: volume 6606f59b-cb62-4b63-a0b8-409ca6996e63 is already attached to instances: edc72a68-5643-42ab-8bed-d8a70c4aaeef Sep 16 02:08:01.955117 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-400aa588-96b0-46ec-a4b0-9b2f9f5ad374 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Request method failure captured: Sep 16 02:08:01.955117 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: request: POST /compute/v2.1/servers/6dcfb746-60d5-48b0-ab19-2d7a235860df/os-volume_attachments HTTP/1.1 Sep 16 02:08:01.955117 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept: application/json Sep 16 02:08:01.955117 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept-Encoding: identity Sep 16 02:08:01.955117 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Connection: close Sep 16 02:08:01.955117 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Length: 74 Sep 16 02:08:01.955117 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Type: application/json Sep 16 02:08:01.955117 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Host: 10.222.0.42 Sep 16 02:08:01.955117 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Openstack-System-Scope: None Sep 16 02:08:01.955117 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: User-Agent: python-urllib3/1.26.12 Sep 16 02:08:01.955117 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Auth-Token: gAAAAABjI9mx6m5YD-VfbXTdOVSmd4NGFLNahGaBbLMo1peJ92wbDVmYwuc5RZgaFUZEqbCVEZU6kOmxNdBXGglNvRlzGtU8he2rrBc7XBc5oNHv9HVVP2iJXpOeBFUkIrXZgk5pRb1fDXNxk7RrwhUPrzMT1uDUBmKj9juzpqGuTgd9rytxkwc Sep 16 02:08:01.955117 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Id: None Sep 16 02:08:01.955117 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Name: None Sep 16 02:08:01.955117 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Identity-Status: Confirmed Sep 16 02:08:01.955117 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Is-Admin-Project: True Sep 16 02:08:01.955117 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Id: default Sep 16 02:08:01.955117 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Name: Default Sep 16 02:08:01.955117 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Id: 663bde66131d47159ffa09ad33971895 Sep 16 02:08:01.955117 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Name: tempest-AttachVolumeNegativeTest-651370638 Sep 16 02:08:01.955117 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Role: member,reader Sep 16 02:08:01.955117 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Roles: member,reader Sep 16 02:08:01.957758 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/663bde66131d47159ffa09ad33971895"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/663bde66131d47159ffa09ad33971895"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_663bde66131d47159ffa09ad33971895"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/663bde66131d47159ffa09ad33971895"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 02:08:01.957758 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant: tempest-AttachVolumeNegativeTest-651370638 Sep 16 02:08:01.957758 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Id: 663bde66131d47159ffa09ad33971895 Sep 16 02:08:01.957758 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-651370638 Sep 16 02:08:01.957758 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User: tempest-AttachVolumeNegativeTest-651370638-project Sep 16 02:08:01.957758 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Id: default Sep 16 02:08:01.957758 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Name: Default Sep 16 02:08:01.957758 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Id: 86bc1b5163f4453db4469fef90f27344 Sep 16 02:08:01.957758 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Name: tempest-AttachVolumeNegativeTest-651370638-project Sep 16 02:08:01.957758 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Sep 16 02:08:01.957758 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: {"volumeAttachment": {"volumeId": "6606f59b-cb62-4b63-a0b8-409ca6996e63"}} Sep 16 02:08:01.957758 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: method: > Sep 16 02:08:01.958706 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: exception: Invalid volume: volume 6606f59b-cb62-4b63-a0b8-409ca6996e63 is already attached to instances: edc72a68-5643-42ab-8bed-d8a70c4aaeef Sep 16 02:08:01.958706 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: action_args: {'server_id': '6dcfb746-60d5-48b0-ab19-2d7a235860df', 'body': {'volumeAttachment': {'volumeId': '6606f59b-cb62-4b63-a0b8-409ca6996e63'}}} Sep 16 02:08:01.958706 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 02:08:01.958706 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:08:01.958706 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 16 02:08:01.958706 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 16 02:08:01.958706 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 16 02:08:01.958706 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 16 02:08:01.958706 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 16 02:08:01.958706 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 16 02:08:01.958706 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 16 02:08:01.958706 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 16 02:08:01.958706 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 16 02:08:01.958706 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 16 02:08:01.958706 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 6606f59b-cb62-4b63-a0b8-409ca6996e63 is already attached to instances: edc72a68-5643-42ab-8bed-d8a70c4aaeef Sep 16 02:08:01.958706 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:08:01.958706 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:08:01.958706 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:08:01.958706 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:08:01.960138 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:08:01.960138 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:08:01.960138 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 02:08:01.960138 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 02:08:01.960138 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 02:08:01.960138 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 02:08:01.960138 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 02:08:01.960138 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 02:08:01.960138 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 02:08:01.960138 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 02:08:01.960138 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 02:08:01.960138 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 02:08:01.960138 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 16 02:08:01.960138 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 16 02:08:01.960138 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 6606f59b-cb62-4b63-a0b8-409ca6996e63 is already attached to instances: edc72a68-5643-42ab-8bed-d8a70c4aaeef Sep 16 02:08:01.960138 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:08:01.960138 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:08:01.960138 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:08:01.960138 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:08:01.960138 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:08:01.961657 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:08:01.961657 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 02:08:01.961657 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 02:08:01.961657 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 6606f59b-cb62-4b63-a0b8-409ca6996e63 is already attached to instances: edc72a68-5643-42ab-8bed-d8a70c4aaeef Sep 16 02:08:01.961657 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:08:01.963792 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-400aa588-96b0-46ec-a4b0-9b2f9f5ad374 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Returning 400 to user: Invalid volume: volume 6606f59b-cb62-4b63-a0b8-409ca6996e63 is already attached to instances: edc72a68-5643-42ab-8bed-d8a70c4aaeef {{(pid=120440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 02:08:01.964881 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-400aa588-96b0-46ec-a4b0-9b2f9f5ad374 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "POST /compute/v2.1/servers/6dcfb746-60d5-48b0-ab19-2d7a235860df/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.119511 Sep 16 02:08:01.965827 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 482/975] 10.222.0.42 () {60 vars in 1323 bytes} [Fri Sep 16 02:08:01 2022] POST /compute/v2.1/servers/6dcfb746-60d5-48b0-ab19-2d7a235860df/os-volume_attachments => generated 174 bytes in 121 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 02:08:01.974887 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-6741ea2d-411b-454d-8d46-36ce71a70845 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:08:01.975417 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-6741ea2d-411b-454d-8d46-36ce71a70845 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: 6dcfb746-60d5-48b0-ab19-2d7a235860df] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:08:01.984954 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-6741ea2d-411b-454d-8d46-36ce71a70845 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:01.985410 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-6741ea2d-411b-454d-8d46-36ce71a70845 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:01.985847 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-6741ea2d-411b-454d-8d46-36ce71a70845 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:01.986546 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-6741ea2d-411b-454d-8d46-36ce71a70845 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:01.987003 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-6741ea2d-411b-454d-8d46-36ce71a70845 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:01.987462 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-6741ea2d-411b-454d-8d46-36ce71a70845 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:02.014518 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-6741ea2d-411b-454d-8d46-36ce71a70845 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: 6dcfb746-60d5-48b0-ab19-2d7a235860df] Going to try to terminate instance {{(pid=120441) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 02:08:02.108560 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-6741ea2d-411b-454d-8d46-36ce71a70845 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6dcfb746-60d5-48b0-ab19-2d7a235860df" status: 204 len: 0 microversion: 2.1 time: 0.137943 Sep 16 02:08:02.109554 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 494/976] 10.222.0.42 () {58 vars in 1239 bytes} [Fri Sep 16 02:08:01 2022] DELETE /compute/v2.1/servers/6dcfb746-60d5-48b0-ab19-2d7a235860df => generated 0 bytes in 140 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 16 02:08:02.128729 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-995f9711-2fc0-4d02-99ba-a4986a7ba797 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:08:02.129590 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-995f9711-2fc0-4d02-99ba-a4986a7ba797 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: 6dcfb746-60d5-48b0-ab19-2d7a235860df] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:08:02.146294 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-995f9711-2fc0-4d02-99ba-a4986a7ba797 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:02.147752 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-995f9711-2fc0-4d02-99ba-a4986a7ba797 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:02.148461 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-995f9711-2fc0-4d02-99ba-a4986a7ba797 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:02.149415 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-995f9711-2fc0-4d02-99ba-a4986a7ba797 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:02.150110 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-995f9711-2fc0-4d02-99ba-a4986a7ba797 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:02.150759 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-995f9711-2fc0-4d02-99ba-a4986a7ba797 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:02.322023 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-995f9711-2fc0-4d02-99ba-a4986a7ba797 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:08:02.330222 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-995f9711-2fc0-4d02-99ba-a4986a7ba797 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/6dcfb746-60d5-48b0-ab19-2d7a235860df" status: 200 len: 1678 microversion: 2.1 time: 0.209194 Sep 16 02:08:02.332159 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 483/977] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:08:02 2022] GET /compute/v2.1/servers/6dcfb746-60d5-48b0-ab19-2d7a235860df => generated 1678 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 02:08:03.356417 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-c10a6619-d9c4-4277-b36e-a9110d8e3eff tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:08:03.357194 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-c10a6619-d9c4-4277-b36e-a9110d8e3eff tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: 6dcfb746-60d5-48b0-ab19-2d7a235860df] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:08:03.365443 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c10a6619-d9c4-4277-b36e-a9110d8e3eff tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:03.365983 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c10a6619-d9c4-4277-b36e-a9110d8e3eff tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:03.366533 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c10a6619-d9c4-4277-b36e-a9110d8e3eff tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:03.367302 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c10a6619-d9c4-4277-b36e-a9110d8e3eff tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:03.367760 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c10a6619-d9c4-4277-b36e-a9110d8e3eff tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:03.368219 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c10a6619-d9c4-4277-b36e-a9110d8e3eff tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:03.500711 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-c10a6619-d9c4-4277-b36e-a9110d8e3eff tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:08:03.508616 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-c10a6619-d9c4-4277-b36e-a9110d8e3eff tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/6dcfb746-60d5-48b0-ab19-2d7a235860df" status: 200 len: 1678 microversion: 2.1 time: 0.157312 Sep 16 02:08:03.509180 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 495/978] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:08:03 2022] GET /compute/v2.1/servers/6dcfb746-60d5-48b0-ab19-2d7a235860df => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:08:04.537601 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-09c2d342-1bdb-42e6-9f6a-ebf79874e31f tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:08:04.538975 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-09c2d342-1bdb-42e6-9f6a-ebf79874e31f tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: 6dcfb746-60d5-48b0-ab19-2d7a235860df] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:08:04.545860 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-09c2d342-1bdb-42e6-9f6a-ebf79874e31f tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:04.546431 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-09c2d342-1bdb-42e6-9f6a-ebf79874e31f tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:04.546840 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-09c2d342-1bdb-42e6-9f6a-ebf79874e31f tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:04.547794 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-09c2d342-1bdb-42e6-9f6a-ebf79874e31f tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:04.548612 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-09c2d342-1bdb-42e6-9f6a-ebf79874e31f tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:04.549197 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-09c2d342-1bdb-42e6-9f6a-ebf79874e31f tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:04.715132 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-09c2d342-1bdb-42e6-9f6a-ebf79874e31f tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:08:04.723480 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-09c2d342-1bdb-42e6-9f6a-ebf79874e31f tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/6dcfb746-60d5-48b0-ab19-2d7a235860df" status: 200 len: 1678 microversion: 2.1 time: 0.194228 Sep 16 02:08:04.724363 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 484/979] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:08:04 2022] GET /compute/v2.1/servers/6dcfb746-60d5-48b0-ab19-2d7a235860df => generated 1678 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:08:05.295704 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [req-a1ff1a2f-182a-4acb-ad9c-d12cb1bb00c7 req-7b0da779-1606-42da-8d56-3fa31e0613d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6dcfb746-60d5-48b0-ab19-2d7a235860df", "name": "network-vif-deleted", "tag": "495f2eea-9dc7-490c-b725-e45ea66fa1a8"}]} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:08:05.312443 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-a1ff1a2f-182a-4acb-ad9c-d12cb1bb00c7 req-7b0da779-1606-42da-8d56-3fa31e0613d6 service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:05.312968 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-a1ff1a2f-182a-4acb-ad9c-d12cb1bb00c7 req-7b0da779-1606-42da-8d56-3fa31e0613d6 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:05.313614 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-a1ff1a2f-182a-4acb-ad9c-d12cb1bb00c7 req-7b0da779-1606-42da-8d56-3fa31e0613d6 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:05.341728 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.compute.server_external_events [req-a1ff1a2f-182a-4acb-ad9c-d12cb1bb00c7 req-7b0da779-1606-42da-8d56-3fa31e0613d6 service nova] Creating event network-vif-deleted:495f2eea-9dc7-490c-b725-e45ea66fa1a8 for instance 6dcfb746-60d5-48b0-ab19-2d7a235860df on hv-cinder-84914 Sep 16 02:08:05.347688 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [req-a1ff1a2f-182a-4acb-ad9c-d12cb1bb00c7 req-7b0da779-1606-42da-8d56-3fa31e0613d6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055218 Sep 16 02:08:05.348326 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 496/980] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:08:05.751347 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-57037dd7-3d7a-48a3-a305-2bafe0270ff1 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:08:05.751997 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-57037dd7-3d7a-48a3-a305-2bafe0270ff1 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: 6dcfb746-60d5-48b0-ab19-2d7a235860df] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:08:05.759683 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-57037dd7-3d7a-48a3-a305-2bafe0270ff1 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:05.760586 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-57037dd7-3d7a-48a3-a305-2bafe0270ff1 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:05.761036 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-57037dd7-3d7a-48a3-a305-2bafe0270ff1 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:05.761777 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-57037dd7-3d7a-48a3-a305-2bafe0270ff1 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:05.762228 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-57037dd7-3d7a-48a3-a305-2bafe0270ff1 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:05.762872 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-57037dd7-3d7a-48a3-a305-2bafe0270ff1 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:05.802509 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-57037dd7-3d7a-48a3-a305-2bafe0270ff1 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:05.803068 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-57037dd7-3d7a-48a3-a305-2bafe0270ff1 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:05.803611 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-57037dd7-3d7a-48a3-a305-2bafe0270ff1 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:05.804230 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.objects.instance [None req-57037dd7-3d7a-48a3-a305-2bafe0270ff1 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lazy-loading 'fault' on Instance uuid 6dcfb746-60d5-48b0-ab19-2d7a235860df {{(pid=120440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 02:08:05.855590 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-57037dd7-3d7a-48a3-a305-2bafe0270ff1 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:08:05.864657 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-57037dd7-3d7a-48a3-a305-2bafe0270ff1 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/6dcfb746-60d5-48b0-ab19-2d7a235860df" status: 200 len: 1330 microversion: 2.1 time: 0.121408 Sep 16 02:08:05.875060 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 485/981] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:08:05 2022] GET /compute/v2.1/servers/6dcfb746-60d5-48b0-ab19-2d7a235860df => generated 1330 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:08:06.891460 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-c8ce703f-5d99-4df0-9ba3-51930e7cd9a4 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:08:06.892196 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-c8ce703f-5d99-4df0-9ba3-51930e7cd9a4 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: 6dcfb746-60d5-48b0-ab19-2d7a235860df] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:08:06.899011 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c8ce703f-5d99-4df0-9ba3-51930e7cd9a4 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:06.899496 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c8ce703f-5d99-4df0-9ba3-51930e7cd9a4 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:06.899948 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c8ce703f-5d99-4df0-9ba3-51930e7cd9a4 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:06.900668 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c8ce703f-5d99-4df0-9ba3-51930e7cd9a4 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:06.901116 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c8ce703f-5d99-4df0-9ba3-51930e7cd9a4 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:06.901536 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c8ce703f-5d99-4df0-9ba3-51930e7cd9a4 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:06.918828 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.wsgi [None req-c8ce703f-5d99-4df0-9ba3-51930e7cd9a4 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] HTTP exception thrown: Instance 6dcfb746-60d5-48b0-ab19-2d7a235860df could not be found. Sep 16 02:08:06.921010 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-c8ce703f-5d99-4df0-9ba3-51930e7cd9a4 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Request method failure captured: Sep 16 02:08:06.921010 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: request: GET /compute/v2.1/servers/6dcfb746-60d5-48b0-ab19-2d7a235860df HTTP/1.1 Sep 16 02:08:06.921010 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Accept: application/json Sep 16 02:08:06.921010 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Accept-Encoding: identity Sep 16 02:08:06.921010 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Connection: close Sep 16 02:08:06.921010 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Content-Length: 0 Sep 16 02:08:06.921010 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Content-Type: application/json Sep 16 02:08:06.921010 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Host: 10.222.0.42 Sep 16 02:08:06.921010 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Openstack-System-Scope: None Sep 16 02:08:06.921010 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: User-Agent: python-urllib3/1.26.12 Sep 16 02:08:06.921010 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Auth-Token: gAAAAABjI9mx6m5YD-VfbXTdOVSmd4NGFLNahGaBbLMo1peJ92wbDVmYwuc5RZgaFUZEqbCVEZU6kOmxNdBXGglNvRlzGtU8he2rrBc7XBc5oNHv9HVVP2iJXpOeBFUkIrXZgk5pRb1fDXNxk7RrwhUPrzMT1uDUBmKj9juzpqGuTgd9rytxkwc Sep 16 02:08:06.921010 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Domain-Id: None Sep 16 02:08:06.921010 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Domain-Name: None Sep 16 02:08:06.921010 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Identity-Status: Confirmed Sep 16 02:08:06.921010 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Is-Admin-Project: True Sep 16 02:08:06.921010 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Domain-Id: default Sep 16 02:08:06.921010 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Domain-Name: Default Sep 16 02:08:06.921010 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Id: 663bde66131d47159ffa09ad33971895 Sep 16 02:08:06.921010 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Name: tempest-AttachVolumeNegativeTest-651370638 Sep 16 02:08:06.921010 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Role: member,reader Sep 16 02:08:06.921010 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Roles: member,reader Sep 16 02:08:06.922625 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/663bde66131d47159ffa09ad33971895"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/663bde66131d47159ffa09ad33971895"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_663bde66131d47159ffa09ad33971895"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/663bde66131d47159ffa09ad33971895"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 02:08:06.922625 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant: tempest-AttachVolumeNegativeTest-651370638 Sep 16 02:08:06.922625 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant-Id: 663bde66131d47159ffa09ad33971895 Sep 16 02:08:06.922625 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-651370638 Sep 16 02:08:06.922625 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User: tempest-AttachVolumeNegativeTest-651370638-project Sep 16 02:08:06.922625 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Domain-Id: default Sep 16 02:08:06.922625 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Domain-Name: Default Sep 16 02:08:06.922625 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Id: 86bc1b5163f4453db4469fef90f27344 Sep 16 02:08:06.922625 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Name: tempest-AttachVolumeNegativeTest-651370638-project Sep 16 02:08:06.922625 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: method: > Sep 16 02:08:06.922625 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: exception: Instance 6dcfb746-60d5-48b0-ab19-2d7a235860df could not be found. Sep 16 02:08:06.922625 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: action_args: {'id': '6dcfb746-60d5-48b0-ab19-2d7a235860df'} Sep 16 02:08:06.923560 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 02:08:06.923560 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:08:06.923560 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 02:08:06.923560 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 02:08:06.923560 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 02:08:06.923560 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 02:08:06.923560 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 02:08:06.923560 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 02:08:06.923560 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 02:08:06.923560 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 02:08:06.923560 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dcfb746-60d5-48b0-ab19-2d7a235860df could not be found. Sep 16 02:08:06.923560 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:08:06.923560 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:08:06.923560 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:08:06.923560 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:08:06.923560 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:08:06.923560 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:08:06.923560 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 02:08:06.923560 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 02:08:06.923560 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 02:08:06.925913 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 02:08:06.925913 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 02:08:06.925913 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 02:08:06.925913 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 02:08:06.925913 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 02:08:06.925913 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 02:08:06.925913 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 02:08:06.925913 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dcfb746-60d5-48b0-ab19-2d7a235860df could not be found. Sep 16 02:08:06.925913 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:08:06.925913 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:08:06.925913 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:08:06.925913 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:08:06.925913 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:08:06.925913 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:08:06.925913 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 02:08:06.925913 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 02:08:06.925913 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dcfb746-60d5-48b0-ab19-2d7a235860df could not be found. Sep 16 02:08:06.925913 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:08:06.927264 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-c8ce703f-5d99-4df0-9ba3-51930e7cd9a4 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Returning 404 to user: Instance 6dcfb746-60d5-48b0-ab19-2d7a235860df could not be found. {{(pid=120441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 02:08:06.927264 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-c8ce703f-5d99-4df0-9ba3-51930e7cd9a4 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/6dcfb746-60d5-48b0-ab19-2d7a235860df" status: 404 len: 111 microversion: 2.1 time: 0.035593 Sep 16 02:08:06.927483 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 497/982] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:08:06 2022] GET /compute/v2.1/servers/6dcfb746-60d5-48b0-ab19-2d7a235860df => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 02:08:06.932447 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-7f2aa3e0-55d2-452f-94bd-72585f60bd67 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '.version_select at 0x7fae32c06d30>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:08:06.953576 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-7f2aa3e0-55d2-452f-94bd-72585f60bd67 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-735069941" status: 202 len: 0 microversion: 2.1 time: 0.024881 Sep 16 02:08:06.954158 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 486/983] 10.222.0.42 () {58 vars in 1218 bytes} [Fri Sep 16 02:08:06 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-735069941 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 02:08:07.680975 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-2734e91d-18db-49e6-9f5b-869d24efeef3 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:08:07.681475 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-2734e91d-18db-49e6-9f5b-869d24efeef3 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: edc72a68-5643-42ab-8bed-d8a70c4aaeef] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:08:07.687495 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2734e91d-18db-49e6-9f5b-869d24efeef3 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:07.688030 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2734e91d-18db-49e6-9f5b-869d24efeef3 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:07.688466 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2734e91d-18db-49e6-9f5b-869d24efeef3 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:07.689164 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2734e91d-18db-49e6-9f5b-869d24efeef3 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:07.689619 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2734e91d-18db-49e6-9f5b-869d24efeef3 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:07.690163 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2734e91d-18db-49e6-9f5b-869d24efeef3 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:07.773350 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.objects.instance [None req-2734e91d-18db-49e6-9f5b-869d24efeef3 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lazy-loading 'services' on Instance uuid edc72a68-5643-42ab-8bed-d8a70c4aaeef {{(pid=120441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 02:08:07.857282 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-2734e91d-18db-49e6-9f5b-869d24efeef3 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "DELETE /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef/os-volume_attachments/6606f59b-cb62-4b63-a0b8-409ca6996e63" status: 202 len: 0 microversion: 2.1 time: 0.180330 Sep 16 02:08:07.857898 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 498/984] 10.222.0.42 () {58 vars in 1416 bytes} [Fri Sep 16 02:08:07 2022] DELETE /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef/os-volume_attachments/6606f59b-cb62-4b63-a0b8-409ca6996e63 => generated 0 bytes in 183 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 02:08:07.867008 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-0278b763-fb12-42ed-8340-39b24aaf57a3 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:08:07.869195 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-0278b763-fb12-42ed-8340-39b24aaf57a3 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: edc72a68-5643-42ab-8bed-d8a70c4aaeef] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:08:07.876113 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0278b763-fb12-42ed-8340-39b24aaf57a3 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:07.876794 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0278b763-fb12-42ed-8340-39b24aaf57a3 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:07.877040 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0278b763-fb12-42ed-8340-39b24aaf57a3 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:07.877834 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0278b763-fb12-42ed-8340-39b24aaf57a3 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:07.878245 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0278b763-fb12-42ed-8340-39b24aaf57a3 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:07.878861 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0278b763-fb12-42ed-8340-39b24aaf57a3 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:07.912309 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-0278b763-fb12-42ed-8340-39b24aaf57a3 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049657 Sep 16 02:08:07.913081 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 487/985] 10.222.0.42 () {58 vars in 1302 bytes} [Fri Sep 16 02:08:07 2022] GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:08:08.927290 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-7d2d1693-9544-4603-9f30-5dff1c724eae tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:08:08.929702 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-7d2d1693-9544-4603-9f30-5dff1c724eae tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: edc72a68-5643-42ab-8bed-d8a70c4aaeef] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:08:08.936491 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7d2d1693-9544-4603-9f30-5dff1c724eae tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:08.937006 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7d2d1693-9544-4603-9f30-5dff1c724eae tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:08.937440 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7d2d1693-9544-4603-9f30-5dff1c724eae tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:08.938141 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7d2d1693-9544-4603-9f30-5dff1c724eae tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:08.938595 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7d2d1693-9544-4603-9f30-5dff1c724eae tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:08.939021 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7d2d1693-9544-4603-9f30-5dff1c724eae tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:08.969099 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-7d2d1693-9544-4603-9f30-5dff1c724eae tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046924 Sep 16 02:08:08.969655 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 499/986] 10.222.0.42 () {58 vars in 1302 bytes} [Fri Sep 16 02:08:08 2022] GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 02:08:09.036987 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-82efbb76-0ffa-4e92-9c86-6055267061ea tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:08:09.037504 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-82efbb76-0ffa-4e92-9c86-6055267061ea tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: edc72a68-5643-42ab-8bed-d8a70c4aaeef] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:08:09.044332 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-82efbb76-0ffa-4e92-9c86-6055267061ea tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:09.044844 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-82efbb76-0ffa-4e92-9c86-6055267061ea tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:09.045284 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-82efbb76-0ffa-4e92-9c86-6055267061ea tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:09.045975 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-82efbb76-0ffa-4e92-9c86-6055267061ea tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:09.046426 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-82efbb76-0ffa-4e92-9c86-6055267061ea tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:09.046878 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-82efbb76-0ffa-4e92-9c86-6055267061ea tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:09.073317 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-82efbb76-0ffa-4e92-9c86-6055267061ea tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: edc72a68-5643-42ab-8bed-d8a70c4aaeef] Going to try to terminate instance {{(pid=120440) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 02:08:09.149682 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-82efbb76-0ffa-4e92-9c86-6055267061ea tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "DELETE /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef" status: 204 len: 0 microversion: 2.1 time: 0.117235 Sep 16 02:08:09.150316 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 488/987] 10.222.0.42 () {58 vars in 1239 bytes} [Fri Sep 16 02:08:09 2022] DELETE /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef => generated 0 bytes in 119 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 02:08:09.158503 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-e34f7ae1-a169-464c-978f-e774fafb350a tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:08:09.159116 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-e34f7ae1-a169-464c-978f-e774fafb350a tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: edc72a68-5643-42ab-8bed-d8a70c4aaeef] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:08:09.165044 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e34f7ae1-a169-464c-978f-e774fafb350a tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:09.165522 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e34f7ae1-a169-464c-978f-e774fafb350a tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:09.165949 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e34f7ae1-a169-464c-978f-e774fafb350a tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:09.166622 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e34f7ae1-a169-464c-978f-e774fafb350a tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:09.167081 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e34f7ae1-a169-464c-978f-e774fafb350a tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:09.167502 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e34f7ae1-a169-464c-978f-e774fafb350a tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:09.311575 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-e34f7ae1-a169-464c-978f-e774fafb350a tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:08:09.320041 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-e34f7ae1-a169-464c-978f-e774fafb350a tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef" status: 200 len: 1678 microversion: 2.1 time: 0.165349 Sep 16 02:08:09.320703 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 500/988] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:08:09 2022] GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef => generated 1678 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:08:10.345019 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-8d900305-3e76-4483-9a45-7dd0e9931533 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:08:10.346652 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-8d900305-3e76-4483-9a45-7dd0e9931533 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: edc72a68-5643-42ab-8bed-d8a70c4aaeef] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:08:10.353350 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8d900305-3e76-4483-9a45-7dd0e9931533 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:10.353827 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8d900305-3e76-4483-9a45-7dd0e9931533 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:10.354377 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8d900305-3e76-4483-9a45-7dd0e9931533 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:10.355081 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8d900305-3e76-4483-9a45-7dd0e9931533 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:10.355540 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8d900305-3e76-4483-9a45-7dd0e9931533 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:10.356036 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8d900305-3e76-4483-9a45-7dd0e9931533 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:10.490425 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-8d900305-3e76-4483-9a45-7dd0e9931533 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:08:10.498140 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-8d900305-3e76-4483-9a45-7dd0e9931533 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef" status: 200 len: 1678 microversion: 2.1 time: 0.157475 Sep 16 02:08:10.498961 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 489/989] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:08:10 2022] GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:08:11.522957 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-b4cf96ef-d47b-440c-ad2b-dd53bad7f59c tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:08:11.523726 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-b4cf96ef-d47b-440c-ad2b-dd53bad7f59c tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: edc72a68-5643-42ab-8bed-d8a70c4aaeef] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:08:11.530632 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b4cf96ef-d47b-440c-ad2b-dd53bad7f59c tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:11.531112 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b4cf96ef-d47b-440c-ad2b-dd53bad7f59c tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:11.531540 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b4cf96ef-d47b-440c-ad2b-dd53bad7f59c tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:11.532251 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b4cf96ef-d47b-440c-ad2b-dd53bad7f59c tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:11.532710 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b4cf96ef-d47b-440c-ad2b-dd53bad7f59c tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:11.533124 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b4cf96ef-d47b-440c-ad2b-dd53bad7f59c tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:11.765220 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-b4cf96ef-d47b-440c-ad2b-dd53bad7f59c tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:08:11.774859 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-b4cf96ef-d47b-440c-ad2b-dd53bad7f59c tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef" status: 200 len: 1678 microversion: 2.1 time: 0.256482 Sep 16 02:08:11.776963 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 501/990] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:08:11 2022] GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef => generated 1678 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:08:12.207193 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell0:SELECT=4 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:08:12.213349 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [req-2138a1f3-9564-4cc5-88f5-dd5b5a9babc7 req-f4ad5505-68a2-4df4-b00d-57e2402d6879 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "edc72a68-5643-42ab-8bed-d8a70c4aaeef", "name": "network-vif-deleted", "tag": "aa7f0fa3-598c-4440-8ab1-72fe07d249af"}]} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:08:12.224946 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-2138a1f3-9564-4cc5-88f5-dd5b5a9babc7 req-f4ad5505-68a2-4df4-b00d-57e2402d6879 service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:12.225588 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-2138a1f3-9564-4cc5-88f5-dd5b5a9babc7 req-f4ad5505-68a2-4df4-b00d-57e2402d6879 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:12.226089 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-2138a1f3-9564-4cc5-88f5-dd5b5a9babc7 req-f4ad5505-68a2-4df4-b00d-57e2402d6879 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:12.238269 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.compute.server_external_events [req-2138a1f3-9564-4cc5-88f5-dd5b5a9babc7 req-f4ad5505-68a2-4df4-b00d-57e2402d6879 service nova] Creating event network-vif-deleted:aa7f0fa3-598c-4440-8ab1-72fe07d249af for instance edc72a68-5643-42ab-8bed-d8a70c4aaeef on hv-cinder-84914 Sep 16 02:08:12.244083 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [req-2138a1f3-9564-4cc5-88f5-dd5b5a9babc7 req-f4ad5505-68a2-4df4-b00d-57e2402d6879 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037474 Sep 16 02:08:12.244859 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 490/991] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:08:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:08:12.799396 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-a7969fc9-b9b8-4862-8cbe-71ba2d32d061 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:08:12.800052 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-a7969fc9-b9b8-4862-8cbe-71ba2d32d061 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: edc72a68-5643-42ab-8bed-d8a70c4aaeef] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:08:12.806853 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a7969fc9-b9b8-4862-8cbe-71ba2d32d061 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:12.807339 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a7969fc9-b9b8-4862-8cbe-71ba2d32d061 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:12.807775 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a7969fc9-b9b8-4862-8cbe-71ba2d32d061 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:12.808513 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a7969fc9-b9b8-4862-8cbe-71ba2d32d061 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:12.808968 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a7969fc9-b9b8-4862-8cbe-71ba2d32d061 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:12.809391 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a7969fc9-b9b8-4862-8cbe-71ba2d32d061 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:12.842997 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a7969fc9-b9b8-4862-8cbe-71ba2d32d061 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:12.843488 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a7969fc9-b9b8-4862-8cbe-71ba2d32d061 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:12.843925 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a7969fc9-b9b8-4862-8cbe-71ba2d32d061 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:12.844395 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.objects.instance [None req-a7969fc9-b9b8-4862-8cbe-71ba2d32d061 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lazy-loading 'fault' on Instance uuid edc72a68-5643-42ab-8bed-d8a70c4aaeef {{(pid=120441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 02:08:12.888465 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-a7969fc9-b9b8-4862-8cbe-71ba2d32d061 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:08:12.897435 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-a7969fc9-b9b8-4862-8cbe-71ba2d32d061 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef" status: 200 len: 1329 microversion: 2.1 time: 0.101782 Sep 16 02:08:12.898017 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 502/992] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:08:12 2022] GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef => generated 1329 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:08:13.922158 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-dc141f9e-acd3-466b-928f-ee7e91de9044 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:08:13.922874 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-dc141f9e-acd3-466b-928f-ee7e91de9044 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: edc72a68-5643-42ab-8bed-d8a70c4aaeef] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:08:13.929807 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-dc141f9e-acd3-466b-928f-ee7e91de9044 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:13.930291 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-dc141f9e-acd3-466b-928f-ee7e91de9044 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:13.930729 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-dc141f9e-acd3-466b-928f-ee7e91de9044 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:13.931517 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-dc141f9e-acd3-466b-928f-ee7e91de9044 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:13.931918 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-dc141f9e-acd3-466b-928f-ee7e91de9044 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:13.932370 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-dc141f9e-acd3-466b-928f-ee7e91de9044 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:13.945467 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.wsgi [None req-dc141f9e-acd3-466b-928f-ee7e91de9044 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] HTTP exception thrown: Instance edc72a68-5643-42ab-8bed-d8a70c4aaeef could not be found. Sep 16 02:08:13.947058 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-dc141f9e-acd3-466b-928f-ee7e91de9044 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Request method failure captured: Sep 16 02:08:13.947058 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: request: GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef HTTP/1.1 Sep 16 02:08:13.947058 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept: application/json Sep 16 02:08:13.947058 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept-Encoding: identity Sep 16 02:08:13.947058 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Connection: close Sep 16 02:08:13.947058 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Length: 0 Sep 16 02:08:13.947058 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Type: application/json Sep 16 02:08:13.947058 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Host: 10.222.0.42 Sep 16 02:08:13.947058 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Openstack-System-Scope: None Sep 16 02:08:13.947058 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: User-Agent: python-urllib3/1.26.12 Sep 16 02:08:13.947058 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Auth-Token: gAAAAABjI9mx6m5YD-VfbXTdOVSmd4NGFLNahGaBbLMo1peJ92wbDVmYwuc5RZgaFUZEqbCVEZU6kOmxNdBXGglNvRlzGtU8he2rrBc7XBc5oNHv9HVVP2iJXpOeBFUkIrXZgk5pRb1fDXNxk7RrwhUPrzMT1uDUBmKj9juzpqGuTgd9rytxkwc Sep 16 02:08:13.947058 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Id: None Sep 16 02:08:13.947058 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Name: None Sep 16 02:08:13.947058 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Identity-Status: Confirmed Sep 16 02:08:13.947058 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Is-Admin-Project: True Sep 16 02:08:13.947058 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Id: default Sep 16 02:08:13.947058 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Name: Default Sep 16 02:08:13.947058 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Id: 663bde66131d47159ffa09ad33971895 Sep 16 02:08:13.947058 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Name: tempest-AttachVolumeNegativeTest-651370638 Sep 16 02:08:13.947058 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Role: member,reader Sep 16 02:08:13.947058 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Roles: member,reader Sep 16 02:08:13.948668 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/663bde66131d47159ffa09ad33971895"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/663bde66131d47159ffa09ad33971895"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_663bde66131d47159ffa09ad33971895"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/663bde66131d47159ffa09ad33971895"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 02:08:13.948668 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant: tempest-AttachVolumeNegativeTest-651370638 Sep 16 02:08:13.948668 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Id: 663bde66131d47159ffa09ad33971895 Sep 16 02:08:13.948668 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-651370638 Sep 16 02:08:13.948668 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User: tempest-AttachVolumeNegativeTest-651370638-project Sep 16 02:08:13.948668 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Id: default Sep 16 02:08:13.948668 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Name: Default Sep 16 02:08:13.948668 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Id: 86bc1b5163f4453db4469fef90f27344 Sep 16 02:08:13.948668 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Name: tempest-AttachVolumeNegativeTest-651370638-project Sep 16 02:08:13.948668 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: method: > Sep 16 02:08:13.948668 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: exception: Instance edc72a68-5643-42ab-8bed-d8a70c4aaeef could not be found. Sep 16 02:08:13.948668 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: action_args: {'id': 'edc72a68-5643-42ab-8bed-d8a70c4aaeef'} Sep 16 02:08:13.949547 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 02:08:13.949547 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:08:13.949547 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 02:08:13.949547 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 02:08:13.949547 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 02:08:13.949547 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 02:08:13.949547 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 02:08:13.949547 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 02:08:13.949547 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 02:08:13.949547 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 02:08:13.949547 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edc72a68-5643-42ab-8bed-d8a70c4aaeef could not be found. Sep 16 02:08:13.949547 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:08:13.949547 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:08:13.949547 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:08:13.949547 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:08:13.949547 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:08:13.949547 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:08:13.949547 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 02:08:13.949547 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 02:08:13.949547 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 02:08:13.950951 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 02:08:13.950951 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 02:08:13.950951 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 02:08:13.950951 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 02:08:13.950951 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 02:08:13.950951 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 02:08:13.950951 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 02:08:13.950951 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edc72a68-5643-42ab-8bed-d8a70c4aaeef could not be found. Sep 16 02:08:13.950951 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:08:13.950951 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:08:13.950951 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:08:13.950951 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:08:13.950951 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:08:13.950951 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:08:13.950951 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 02:08:13.950951 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 02:08:13.950951 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edc72a68-5643-42ab-8bed-d8a70c4aaeef could not be found. Sep 16 02:08:13.950951 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:08:13.952352 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-dc141f9e-acd3-466b-928f-ee7e91de9044 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Returning 404 to user: Instance edc72a68-5643-42ab-8bed-d8a70c4aaeef could not be found. {{(pid=120440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 02:08:13.952352 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-dc141f9e-acd3-466b-928f-ee7e91de9044 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef" status: 404 len: 111 microversion: 2.1 time: 0.030995 Sep 16 02:08:13.952352 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 491/993] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:08:13 2022] GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 02:08:13.957733 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-43214bb3-7fcf-4a86-9bed-47aa44a9dd44 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '.version_select at 0x7fae361c8820>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:08:13.977042 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-43214bb3-7fcf-4a86-9bed-47aa44a9dd44 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-700618004" status: 202 len: 0 microversion: 2.1 time: 0.023474 Sep 16 02:08:13.977627 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 503/994] 10.222.0.42 () {58 vars in 1218 bytes} [Fri Sep 16 02:08:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-700618004 => generated 0 bytes in 25 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 02:08:14.594078 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-4693f8b5-318d-4d66-a22f-b3cf0bdfe824 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Action: 'create', calling method: .version_select at 0x7fae32b2d820>, body: {"keypair": {"name": "tempest-keypair-931151170", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCoIwYy7e9SrSbPFySE9jHuLastE3WTIWe9rp/j36IxwBg4eFiYb34spoYvZze8wOPlhhfOHQVHRb4REkrgY6ufx1pv1CCpWqYRcbmiCks++zMKFO81WA9zCW0jhI5mRSg=="}} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:08:14.610246 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.quota [None req-4693f8b5-318d-4d66-a22f-b3cf0bdfe824 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Getting quotas for project 663bde66131d47159ffa09ad33971895. Resources: {'key_pairs'} {{(pid=120440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 02:08:14.614929 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.quota [None req-4693f8b5-318d-4d66-a22f-b3cf0bdfe824 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Getting quotas for user 86bc1b5163f4453db4469fef90f27344 and project 663bde66131d47159ffa09ad33971895. Resources: {'key_pairs'} {{(pid=120440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 02:08:14.637874 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-4693f8b5-318d-4d66-a22f-b3cf0bdfe824 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.047589 Sep 16 02:08:14.638443 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 492/995] 10.222.0.42 () {60 vars in 1159 bytes} [Fri Sep 16 02:08:14 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:08:15.885469 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-910b9b2b-037b-4d5e-9e42-4f2da8713225 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-151373473", "imageRef": "1546da04-912c-44c6-b4b9-34fba35e08f6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "80b93367-5ee2-4183-922b-cb2be17dc7b7"}], "security_groups": [{"name": "tempest-securitygroup--721163039"}], "key_name": "tempest-keypair-931151170", "user_data": "}} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:08:15.985465 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.network.neutron [None req-910b9b2b-037b-4d5e-9e42-4f2da8713225 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] validate_networks() for [('80b93367-5ee2-4183-922b-cb2be17dc7b7', None, None, None, None, None)] {{(pid=120441) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 02:08:16.441978 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.virt.hardware [None req-910b9b2b-037b-4d5e-9e42-4f2da8713225 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Flavor limits 0:0:0 {{(pid=120441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 02:08:16.442394 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.virt.hardware [None req-910b9b2b-037b-4d5e-9e42-4f2da8713225 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Image limits 0:0:0 {{(pid=120441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 02:08:16.442861 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.virt.hardware [None req-910b9b2b-037b-4d5e-9e42-4f2da8713225 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Flavor pref 0:0:0 {{(pid=120441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 02:08:16.443266 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.virt.hardware [None req-910b9b2b-037b-4d5e-9e42-4f2da8713225 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Image pref 0:0:0 {{(pid=120441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 02:08:16.443670 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.virt.hardware [None req-910b9b2b-037b-4d5e-9e42-4f2da8713225 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 02:08:16.452357 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-910b9b2b-037b-4d5e-9e42-4f2da8713225 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:16.452832 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-910b9b2b-037b-4d5e-9e42-4f2da8713225 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:16.453256 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-910b9b2b-037b-4d5e-9e42-4f2da8713225 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:16.453971 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-910b9b2b-037b-4d5e-9e42-4f2da8713225 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:16.454417 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-910b9b2b-037b-4d5e-9e42-4f2da8713225 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:16.454833 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-910b9b2b-037b-4d5e-9e42-4f2da8713225 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:16.473041 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.quota [None req-910b9b2b-037b-4d5e-9e42-4f2da8713225 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Getting quotas for project 663bde66131d47159ffa09ad33971895. Resources: {'cores', 'ram', 'instances'} {{(pid=120441) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 02:08:16.476880 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.quota [None req-910b9b2b-037b-4d5e-9e42-4f2da8713225 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Getting quotas for user 86bc1b5163f4453db4469fef90f27344 and project 663bde66131d47159ffa09ad33971895. Resources: {'cores', 'ram', 'instances'} {{(pid=120441) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 02:08:16.487512 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-910b9b2b-037b-4d5e-9e42-4f2da8713225 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Going to run 1 instances... {{(pid=120441) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 02:08:16.489814 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-910b9b2b-037b-4d5e-9e42-4f2da8713225 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: a3d82b31-1f43-429e-84a1-483acae4dbac] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1546da04-912c-44c6-b4b9-34fba35e08f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120441) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 02:08:16.535988 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-910b9b2b-037b-4d5e-9e42-4f2da8713225 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.655301 Sep 16 02:08:16.536616 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 504/996] 10.222.0.42 () {60 vars in 1147 bytes} [Fri Sep 16 02:08:15 2022] POST /compute/v2.1/servers => generated 401 bytes in 657 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 02:08:16.548855 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-09e80137-cf0a-42d1-b149-716b5254d31a tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:08:16.549543 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-09e80137-cf0a-42d1-b149-716b5254d31a tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: a3d82b31-1f43-429e-84a1-483acae4dbac] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:08:16.604761 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-09e80137-cf0a-42d1-b149-716b5254d31a tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:08:16.611560 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-09e80137-cf0a-42d1-b149-716b5254d31a tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/a3d82b31-1f43-429e-84a1-483acae4dbac" status: 200 len: 1240 microversion: 2.1 time: 0.067640 Sep 16 02:08:16.612153 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 493/997] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:08:16 2022] GET /compute/v2.1/servers/a3d82b31-1f43-429e-84a1-483acae4dbac => generated 1240 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:08:17.635850 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-1e97090b-d28f-4a8f-8f66-fdf438485659 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:08:17.637734 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-1e97090b-d28f-4a8f-8f66-fdf438485659 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: a3d82b31-1f43-429e-84a1-483acae4dbac] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:08:17.644540 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1e97090b-d28f-4a8f-8f66-fdf438485659 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:17.645285 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1e97090b-d28f-4a8f-8f66-fdf438485659 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:17.645722 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1e97090b-d28f-4a8f-8f66-fdf438485659 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:17.646425 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1e97090b-d28f-4a8f-8f66-fdf438485659 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:17.646873 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1e97090b-d28f-4a8f-8f66-fdf438485659 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:17.647452 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1e97090b-d28f-4a8f-8f66-fdf438485659 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:17.870451 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-1e97090b-d28f-4a8f-8f66-fdf438485659 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:08:17.878941 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-1e97090b-d28f-4a8f-8f66-fdf438485659 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/a3d82b31-1f43-429e-84a1-483acae4dbac" status: 200 len: 1300 microversion: 2.1 time: 0.246859 Sep 16 02:08:17.879693 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 505/998] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:08:17 2022] GET /compute/v2.1/servers/a3d82b31-1f43-429e-84a1-483acae4dbac => generated 1300 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:08:18.902273 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-e78e7c4c-743f-484e-8268-66bdda846ca4 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:08:18.903034 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-e78e7c4c-743f-484e-8268-66bdda846ca4 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: a3d82b31-1f43-429e-84a1-483acae4dbac] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:08:18.909499 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e78e7c4c-743f-484e-8268-66bdda846ca4 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:18.910223 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e78e7c4c-743f-484e-8268-66bdda846ca4 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:18.910852 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e78e7c4c-743f-484e-8268-66bdda846ca4 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:18.911727 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e78e7c4c-743f-484e-8268-66bdda846ca4 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:18.912281 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e78e7c4c-743f-484e-8268-66bdda846ca4 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:18.912704 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e78e7c4c-743f-484e-8268-66bdda846ca4 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:19.045565 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-e78e7c4c-743f-484e-8268-66bdda846ca4 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:08:19.053709 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-e78e7c4c-743f-484e-8268-66bdda846ca4 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/a3d82b31-1f43-429e-84a1-483acae4dbac" status: 200 len: 1365 microversion: 2.1 time: 0.155286 Sep 16 02:08:19.054291 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 494/999] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:08:18 2022] GET /compute/v2.1/servers/a3d82b31-1f43-429e-84a1-483acae4dbac => generated 1365 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:08:19.127204 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [req-ea7fb89d-f63b-4c84-b64c-a642aadcc206 req-82eedf5f-d5e7-40a9-b528-cd6a37c9f05d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3d82b31-1f43-429e-84a1-483acae4dbac", "tag": "5a10d469-3480-4bed-8934-5fbc18a639f7"}]} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:08:19.138575 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-ea7fb89d-f63b-4c84-b64c-a642aadcc206 req-82eedf5f-d5e7-40a9-b528-cd6a37c9f05d service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:19.139426 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-ea7fb89d-f63b-4c84-b64c-a642aadcc206 req-82eedf5f-d5e7-40a9-b528-cd6a37c9f05d service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:19.139968 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-ea7fb89d-f63b-4c84-b64c-a642aadcc206 req-82eedf5f-d5e7-40a9-b528-cd6a37c9f05d service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:19.152482 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.compute.server_external_events [req-ea7fb89d-f63b-4c84-b64c-a642aadcc206 req-82eedf5f-d5e7-40a9-b528-cd6a37c9f05d service nova] Creating event network-changed:5a10d469-3480-4bed-8934-5fbc18a639f7 for instance a3d82b31-1f43-429e-84a1-483acae4dbac on hv-cinder-84914 Sep 16 02:08:19.157227 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [req-ea7fb89d-f63b-4c84-b64c-a642aadcc206 req-82eedf5f-d5e7-40a9-b528-cd6a37c9f05d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033959 Sep 16 02:08:19.157807 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 506/1000] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:08:19 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 02:08:20.077613 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-5750f48f-e5de-4cf7-b3f0-9771c5999ff0 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:08:20.078168 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-5750f48f-e5de-4cf7-b3f0-9771c5999ff0 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: a3d82b31-1f43-429e-84a1-483acae4dbac] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:08:20.085423 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-5750f48f-e5de-4cf7-b3f0-9771c5999ff0 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:20.085910 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-5750f48f-e5de-4cf7-b3f0-9771c5999ff0 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:20.086351 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-5750f48f-e5de-4cf7-b3f0-9771c5999ff0 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:20.087044 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-5750f48f-e5de-4cf7-b3f0-9771c5999ff0 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:20.087500 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-5750f48f-e5de-4cf7-b3f0-9771c5999ff0 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:20.087952 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-5750f48f-e5de-4cf7-b3f0-9771c5999ff0 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:20.223131 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-5750f48f-e5de-4cf7-b3f0-9771c5999ff0 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:08:20.230690 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-5750f48f-e5de-4cf7-b3f0-9771c5999ff0 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/a3d82b31-1f43-429e-84a1-483acae4dbac" status: 200 len: 1365 microversion: 2.1 time: 0.156977 Sep 16 02:08:20.231255 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 495/1001] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:08:20 2022] GET /compute/v2.1/servers/a3d82b31-1f43-429e-84a1-483acae4dbac => generated 1365 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:08:21.255011 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-0972f8b8-f51c-4f9c-bfd0-6ebfdf98d2f3 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:08:21.255710 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-0972f8b8-f51c-4f9c-bfd0-6ebfdf98d2f3 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: a3d82b31-1f43-429e-84a1-483acae4dbac] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:08:21.262490 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0972f8b8-f51c-4f9c-bfd0-6ebfdf98d2f3 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:21.262976 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0972f8b8-f51c-4f9c-bfd0-6ebfdf98d2f3 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:21.263414 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0972f8b8-f51c-4f9c-bfd0-6ebfdf98d2f3 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:21.264137 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0972f8b8-f51c-4f9c-bfd0-6ebfdf98d2f3 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:21.264594 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0972f8b8-f51c-4f9c-bfd0-6ebfdf98d2f3 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:21.265019 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0972f8b8-f51c-4f9c-bfd0-6ebfdf98d2f3 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:21.396340 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-0972f8b8-f51c-4f9c-bfd0-6ebfdf98d2f3 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:08:21.403902 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-0972f8b8-f51c-4f9c-bfd0-6ebfdf98d2f3 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/a3d82b31-1f43-429e-84a1-483acae4dbac" status: 200 len: 1365 microversion: 2.1 time: 0.154209 Sep 16 02:08:21.404483 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 507/1002] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:08:21 2022] GET /compute/v2.1/servers/a3d82b31-1f43-429e-84a1-483acae4dbac => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:08:22.426637 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-7654ca51-43aa-41a5-9714-a939d89aa81d tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:08:22.427224 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-7654ca51-43aa-41a5-9714-a939d89aa81d tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: a3d82b31-1f43-429e-84a1-483acae4dbac] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:08:22.433573 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7654ca51-43aa-41a5-9714-a939d89aa81d tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:22.434047 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7654ca51-43aa-41a5-9714-a939d89aa81d tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:22.434477 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7654ca51-43aa-41a5-9714-a939d89aa81d tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:22.435156 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7654ca51-43aa-41a5-9714-a939d89aa81d tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:22.435598 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7654ca51-43aa-41a5-9714-a939d89aa81d tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:22.436044 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7654ca51-43aa-41a5-9714-a939d89aa81d tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:22.564207 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-7654ca51-43aa-41a5-9714-a939d89aa81d tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:08:22.572268 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-7654ca51-43aa-41a5-9714-a939d89aa81d tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/a3d82b31-1f43-429e-84a1-483acae4dbac" status: 200 len: 1365 microversion: 2.1 time: 0.149536 Sep 16 02:08:22.572821 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 496/1003] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:08:22 2022] GET /compute/v2.1/servers/a3d82b31-1f43-429e-84a1-483acae4dbac => generated 1365 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:08:23.596120 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-1053a984-6861-4d9b-835e-403732e2144b tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:08:23.597435 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-1053a984-6861-4d9b-835e-403732e2144b tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: a3d82b31-1f43-429e-84a1-483acae4dbac] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:08:23.603468 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1053a984-6861-4d9b-835e-403732e2144b tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:23.603978 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1053a984-6861-4d9b-835e-403732e2144b tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:23.604422 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1053a984-6861-4d9b-835e-403732e2144b tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:23.605115 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1053a984-6861-4d9b-835e-403732e2144b tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:23.605570 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1053a984-6861-4d9b-835e-403732e2144b tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:23.605997 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1053a984-6861-4d9b-835e-403732e2144b tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:23.842821 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-1053a984-6861-4d9b-835e-403732e2144b tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:08:23.851197 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-1053a984-6861-4d9b-835e-403732e2144b tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/a3d82b31-1f43-429e-84a1-483acae4dbac" status: 200 len: 1365 microversion: 2.1 time: 0.259138 Sep 16 02:08:23.851765 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 508/1004] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:08:23 2022] GET /compute/v2.1/servers/a3d82b31-1f43-429e-84a1-483acae4dbac => generated 1365 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:08:24.194064 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-db0ee614-8e5a-47d7-9de7-a120b11aab26 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1053951836", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1042516554", "security_groups": [{"name": "tempest-secgroup-smoke-201932569"}], "block_device_mapping_v2": [{"uuid": "ed0b2ae5-5091-4593-a823-7d08008cea99", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "26a960ea-9980-48fb-8180-c5983fb286de"}]}} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:08:24.306914 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.network.neutron [None req-db0ee614-8e5a-47d7-9de7-a120b11aab26 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] validate_networks() for [('26a960ea-9980-48fb-8180-c5983fb286de', None, None, None, None, None)] {{(pid=120440) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 02:08:24.670007 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.virt.hardware [None req-db0ee614-8e5a-47d7-9de7-a120b11aab26 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Flavor limits 0:0:0 {{(pid=120440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 02:08:24.670454 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.virt.hardware [None req-db0ee614-8e5a-47d7-9de7-a120b11aab26 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Image limits 0:0:0 {{(pid=120440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 02:08:24.671060 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.virt.hardware [None req-db0ee614-8e5a-47d7-9de7-a120b11aab26 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Flavor pref 0:0:0 {{(pid=120440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 02:08:24.671471 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.virt.hardware [None req-db0ee614-8e5a-47d7-9de7-a120b11aab26 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Image pref 0:0:0 {{(pid=120440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 02:08:24.671914 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.virt.hardware [None req-db0ee614-8e5a-47d7-9de7-a120b11aab26 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 02:08:24.681466 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-db0ee614-8e5a-47d7-9de7-a120b11aab26 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:24.681949 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-db0ee614-8e5a-47d7-9de7-a120b11aab26 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:24.682381 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-db0ee614-8e5a-47d7-9de7-a120b11aab26 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:24.683108 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-db0ee614-8e5a-47d7-9de7-a120b11aab26 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:24.683562 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-db0ee614-8e5a-47d7-9de7-a120b11aab26 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:24.684012 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-db0ee614-8e5a-47d7-9de7-a120b11aab26 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:24.700952 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.quota [None req-db0ee614-8e5a-47d7-9de7-a120b11aab26 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Getting quotas for project 9cfcd2376b1c4398befa49b423aaae26. Resources: {'cores', 'ram', 'instances'} {{(pid=120440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 02:08:24.704953 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.quota [None req-db0ee614-8e5a-47d7-9de7-a120b11aab26 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Getting quotas for user 772659a1932d45dea2c5120c4497314b and project 9cfcd2376b1c4398befa49b423aaae26. Resources: {'cores', 'ram', 'instances'} {{(pid=120440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 02:08:24.758079 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [req-94ed2fca-7137-4bab-a39d-b5bc7e096cb1 req-3591cc6a-b4b1-4b16-aa3c-cf5ca69b0331 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3d82b31-1f43-429e-84a1-483acae4dbac", "name": "network-vif-plugged", "status": "completed", "tag": "5a10d469-3480-4bed-8934-5fbc18a639f7"}]} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:08:24.774557 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-94ed2fca-7137-4bab-a39d-b5bc7e096cb1 req-3591cc6a-b4b1-4b16-aa3c-cf5ca69b0331 service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:24.775058 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-94ed2fca-7137-4bab-a39d-b5bc7e096cb1 req-3591cc6a-b4b1-4b16-aa3c-cf5ca69b0331 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:24.775496 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-94ed2fca-7137-4bab-a39d-b5bc7e096cb1 req-3591cc6a-b4b1-4b16-aa3c-cf5ca69b0331 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:24.781972 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-db0ee614-8e5a-47d7-9de7-a120b11aab26 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Going to run 1 instances... {{(pid=120440) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 02:08:24.784692 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-db0ee614-8e5a-47d7-9de7-a120b11aab26 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: c2851de3-9ab0-467a-8026-5b44a95c5493] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ed0b2ae5-5091-4593-a823-7d08008cea99',volume_size=None,volume_type=None)] {{(pid=120440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 02:08:24.787211 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.compute.server_external_events [req-94ed2fca-7137-4bab-a39d-b5bc7e096cb1 req-3591cc6a-b4b1-4b16-aa3c-cf5ca69b0331 service nova] Creating event network-vif-plugged:5a10d469-3480-4bed-8934-5fbc18a639f7 for instance a3d82b31-1f43-429e-84a1-483acae4dbac on hv-cinder-84914 Sep 16 02:08:24.792372 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [req-94ed2fca-7137-4bab-a39d-b5bc7e096cb1 req-3591cc6a-b4b1-4b16-aa3c-cf5ca69b0331 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038113 Sep 16 02:08:24.793048 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 509/1005] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:08:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:08:24.875409 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-ef886497-378a-4892-be9e-2b2194cf32e2 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:08:24.876232 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-ef886497-378a-4892-be9e-2b2194cf32e2 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: a3d82b31-1f43-429e-84a1-483acae4dbac] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:08:24.882325 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ef886497-378a-4892-be9e-2b2194cf32e2 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:24.882814 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ef886497-378a-4892-be9e-2b2194cf32e2 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:24.883252 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ef886497-378a-4892-be9e-2b2194cf32e2 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:24.883965 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ef886497-378a-4892-be9e-2b2194cf32e2 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:24.884438 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ef886497-378a-4892-be9e-2b2194cf32e2 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:24.884867 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ef886497-378a-4892-be9e-2b2194cf32e2 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:24.934614 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-db0ee614-8e5a-47d7-9de7-a120b11aab26 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.745104 Sep 16 02:08:24.935488 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 497/1006] 10.222.0.42 () {60 vars in 1147 bytes} [Fri Sep 16 02:08:24 2022] POST /compute/v2.1/servers => generated 405 bytes in 747 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 02:08:24.947080 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-cdfde16c-f452-4bf5-91f6-185db7a05395 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:08:24.947901 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-cdfde16c-f452-4bf5-91f6-185db7a05395 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: c2851de3-9ab0-467a-8026-5b44a95c5493] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:08:25.013066 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-cdfde16c-f452-4bf5-91f6-185db7a05395 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:08:25.021079 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-cdfde16c-f452-4bf5-91f6-185db7a05395 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/c2851de3-9ab0-467a-8026-5b44a95c5493" status: 200 len: 1095 microversion: 2.1 time: 0.078391 Sep 16 02:08:25.021847 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 498/1007] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:08:24 2022] GET /compute/v2.1/servers/c2851de3-9ab0-467a-8026-5b44a95c5493 => generated 1095 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:08:25.088953 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-ef886497-378a-4892-be9e-2b2194cf32e2 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:08:25.097797 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-ef886497-378a-4892-be9e-2b2194cf32e2 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/a3d82b31-1f43-429e-84a1-483acae4dbac" status: 200 len: 1365 microversion: 2.1 time: 0.225857 Sep 16 02:08:25.098359 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 510/1008] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:08:24 2022] GET /compute/v2.1/servers/a3d82b31-1f43-429e-84a1-483acae4dbac => generated 1365 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:08:26.043486 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-d512203c-3209-402e-ac61-9bfbb98fe99a tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:08:26.044149 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-d512203c-3209-402e-ac61-9bfbb98fe99a tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: c2851de3-9ab0-467a-8026-5b44a95c5493] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:08:26.050602 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d512203c-3209-402e-ac61-9bfbb98fe99a tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:26.051084 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d512203c-3209-402e-ac61-9bfbb98fe99a tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:26.051518 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d512203c-3209-402e-ac61-9bfbb98fe99a tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:26.052257 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d512203c-3209-402e-ac61-9bfbb98fe99a tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:26.052710 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d512203c-3209-402e-ac61-9bfbb98fe99a tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:26.053166 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d512203c-3209-402e-ac61-9bfbb98fe99a tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:26.114583 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-d512203c-3209-402e-ac61-9bfbb98fe99a tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:08:26.122219 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-716d89d7-4c91-415f-899b-f87e2429c232 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:08:26.122889 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-716d89d7-4c91-415f-899b-f87e2429c232 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: a3d82b31-1f43-429e-84a1-483acae4dbac] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:08:26.123791 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-d512203c-3209-402e-ac61-9bfbb98fe99a tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/c2851de3-9ab0-467a-8026-5b44a95c5493" status: 200 len: 1137 microversion: 2.1 time: 0.083759 Sep 16 02:08:26.136022 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 499/1009] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:08:26 2022] GET /compute/v2.1/servers/c2851de3-9ab0-467a-8026-5b44a95c5493 => generated 1137 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:08:26.136224 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-716d89d7-4c91-415f-899b-f87e2429c232 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:26.136224 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-716d89d7-4c91-415f-899b-f87e2429c232 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:26.136224 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-716d89d7-4c91-415f-899b-f87e2429c232 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:26.136224 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-716d89d7-4c91-415f-899b-f87e2429c232 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:26.136586 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-716d89d7-4c91-415f-899b-f87e2429c232 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:26.136586 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-716d89d7-4c91-415f-899b-f87e2429c232 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:26.150767 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:08:26.265483 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-716d89d7-4c91-415f-899b-f87e2429c232 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:08:26.273617 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-716d89d7-4c91-415f-899b-f87e2429c232 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/a3d82b31-1f43-429e-84a1-483acae4dbac" status: 200 len: 1365 microversion: 2.1 time: 0.155276 Sep 16 02:08:26.274235 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 511/1010] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:08:26 2022] GET /compute/v2.1/servers/a3d82b31-1f43-429e-84a1-483acae4dbac => generated 1365 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 02:08:27.149174 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-81d1117b-d8f4-4fff-a094-a761457aaced tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:08:27.149848 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-81d1117b-d8f4-4fff-a094-a761457aaced tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: c2851de3-9ab0-467a-8026-5b44a95c5493] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:08:27.156145 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-81d1117b-d8f4-4fff-a094-a761457aaced tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:27.156638 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-81d1117b-d8f4-4fff-a094-a761457aaced tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:27.157077 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-81d1117b-d8f4-4fff-a094-a761457aaced tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:27.157783 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-81d1117b-d8f4-4fff-a094-a761457aaced tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:27.158336 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-81d1117b-d8f4-4fff-a094-a761457aaced tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:27.158733 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-81d1117b-d8f4-4fff-a094-a761457aaced tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:27.225241 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-81d1117b-d8f4-4fff-a094-a761457aaced tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:08:27.235098 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-81d1117b-d8f4-4fff-a094-a761457aaced tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/c2851de3-9ab0-467a-8026-5b44a95c5493" status: 200 len: 1201 microversion: 2.1 time: 0.089718 Sep 16 02:08:27.242169 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 500/1011] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:08:27 2022] GET /compute/v2.1/servers/c2851de3-9ab0-467a-8026-5b44a95c5493 => generated 1201 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:08:27.296459 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-0c2ba25d-43eb-4830-ad19-31e808708fb5 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:08:27.297076 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-0c2ba25d-43eb-4830-ad19-31e808708fb5 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: a3d82b31-1f43-429e-84a1-483acae4dbac] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:08:27.298870 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell0:SELECT=2 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:08:27.299653 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell0:SELECT=6 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:08:27.306021 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0c2ba25d-43eb-4830-ad19-31e808708fb5 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:27.306518 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0c2ba25d-43eb-4830-ad19-31e808708fb5 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:27.306961 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0c2ba25d-43eb-4830-ad19-31e808708fb5 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:27.307661 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0c2ba25d-43eb-4830-ad19-31e808708fb5 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:27.308151 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0c2ba25d-43eb-4830-ad19-31e808708fb5 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:27.308593 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0c2ba25d-43eb-4830-ad19-31e808708fb5 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:27.787736 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-0c2ba25d-43eb-4830-ad19-31e808708fb5 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:08:27.796722 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-0c2ba25d-43eb-4830-ad19-31e808708fb5 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/a3d82b31-1f43-429e-84a1-483acae4dbac" status: 200 len: 1554 microversion: 2.1 time: 0.504080 Sep 16 02:08:27.797553 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 512/1012] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:08:27 2022] GET /compute/v2.1/servers/a3d82b31-1f43-429e-84a1-483acae4dbac => generated 1554 bytes in 506 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:08:27.824596 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-8b94a8b4-72e7-43df-ac22-061c091ce800 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:08:27.825158 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-8b94a8b4-72e7-43df-ac22-061c091ce800 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: a3d82b31-1f43-429e-84a1-483acae4dbac] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:08:27.831930 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8b94a8b4-72e7-43df-ac22-061c091ce800 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:27.832615 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8b94a8b4-72e7-43df-ac22-061c091ce800 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:27.833235 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8b94a8b4-72e7-43df-ac22-061c091ce800 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:27.833930 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8b94a8b4-72e7-43df-ac22-061c091ce800 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:27.834379 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8b94a8b4-72e7-43df-ac22-061c091ce800 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:27.834798 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8b94a8b4-72e7-43df-ac22-061c091ce800 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:27.915997 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-8b94a8b4-72e7-43df-ac22-061c091ce800 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/a3d82b31-1f43-429e-84a1-483acae4dbac/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.095149 Sep 16 02:08:27.916659 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 501/1013] 10.222.0.42 () {58 vars in 1275 bytes} [Fri Sep 16 02:08:27 2022] GET /compute/v2.1/servers/a3d82b31-1f43-429e-84a1-483acae4dbac/os-interface => generated 284 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:08:28.258653 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-c455106f-c1b0-45ce-9281-87b1ccf558b5 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:08:28.259290 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-c455106f-c1b0-45ce-9281-87b1ccf558b5 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: c2851de3-9ab0-467a-8026-5b44a95c5493] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:08:28.265618 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c455106f-c1b0-45ce-9281-87b1ccf558b5 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:28.266108 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c455106f-c1b0-45ce-9281-87b1ccf558b5 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:28.266545 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c455106f-c1b0-45ce-9281-87b1ccf558b5 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:28.267242 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c455106f-c1b0-45ce-9281-87b1ccf558b5 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:28.267726 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c455106f-c1b0-45ce-9281-87b1ccf558b5 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:28.268409 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-c455106f-c1b0-45ce-9281-87b1ccf558b5 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:28.376643 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-c455106f-c1b0-45ce-9281-87b1ccf558b5 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:08:28.384954 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-c455106f-c1b0-45ce-9281-87b1ccf558b5 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/c2851de3-9ab0-467a-8026-5b44a95c5493" status: 200 len: 1199 microversion: 2.1 time: 0.130330 Sep 16 02:08:28.385720 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 513/1014] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:08:28 2022] GET /compute/v2.1/servers/c2851de3-9ab0-467a-8026-5b44a95c5493 => generated 1199 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:08:29.411408 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-7ded1fbd-07d8-45d7-aae3-ab36dfc52d1e tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:08:29.412194 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-7ded1fbd-07d8-45d7-aae3-ab36dfc52d1e tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: c2851de3-9ab0-467a-8026-5b44a95c5493] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:08:29.418305 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7ded1fbd-07d8-45d7-aae3-ab36dfc52d1e tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:29.418790 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7ded1fbd-07d8-45d7-aae3-ab36dfc52d1e tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:29.419427 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7ded1fbd-07d8-45d7-aae3-ab36dfc52d1e tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:29.420155 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7ded1fbd-07d8-45d7-aae3-ab36dfc52d1e tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:29.420611 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7ded1fbd-07d8-45d7-aae3-ab36dfc52d1e tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:29.421032 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7ded1fbd-07d8-45d7-aae3-ab36dfc52d1e tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:29.489704 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [req-9898411c-ce07-4f3b-be43-0227d300230a req-a2ee1de2-7c97-4136-8795-dcfe3a25b74f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a3d82b31-1f43-429e-84a1-483acae4dbac", "tag": "5a10d469-3480-4bed-8934-5fbc18a639f7"}]} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:08:29.511305 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-9898411c-ce07-4f3b-be43-0227d300230a req-a2ee1de2-7c97-4136-8795-dcfe3a25b74f service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:29.512131 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-9898411c-ce07-4f3b-be43-0227d300230a req-a2ee1de2-7c97-4136-8795-dcfe3a25b74f service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:29.513680 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-9898411c-ce07-4f3b-be43-0227d300230a req-a2ee1de2-7c97-4136-8795-dcfe3a25b74f service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:29.529914 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.compute.server_external_events [req-9898411c-ce07-4f3b-be43-0227d300230a req-a2ee1de2-7c97-4136-8795-dcfe3a25b74f service nova] Creating event network-changed:5a10d469-3480-4bed-8934-5fbc18a639f7 for instance a3d82b31-1f43-429e-84a1-483acae4dbac on hv-cinder-84914 Sep 16 02:08:29.536854 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [req-9898411c-ce07-4f3b-be43-0227d300230a req-a2ee1de2-7c97-4136-8795-dcfe3a25b74f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.054803 Sep 16 02:08:29.538195 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 514/1015] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:08:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:08:29.575403 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-7ded1fbd-07d8-45d7-aae3-ab36dfc52d1e tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:08:29.579465 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:08:29.585595 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-7ded1fbd-07d8-45d7-aae3-ab36dfc52d1e tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/c2851de3-9ab0-467a-8026-5b44a95c5493" status: 200 len: 1266 microversion: 2.1 time: 0.180761 Sep 16 02:08:29.586364 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 502/1016] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:08:29 2022] GET /compute/v2.1/servers/c2851de3-9ab0-467a-8026-5b44a95c5493 => generated 1266 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:08:30.610270 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-aafe32f0-9a51-4d10-bdd3-a8876d8a2a49 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:08:30.610975 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-aafe32f0-9a51-4d10-bdd3-a8876d8a2a49 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: c2851de3-9ab0-467a-8026-5b44a95c5493] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:08:30.618217 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-aafe32f0-9a51-4d10-bdd3-a8876d8a2a49 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:30.618707 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-aafe32f0-9a51-4d10-bdd3-a8876d8a2a49 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:30.619144 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-aafe32f0-9a51-4d10-bdd3-a8876d8a2a49 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:30.619840 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-aafe32f0-9a51-4d10-bdd3-a8876d8a2a49 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:30.620537 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-aafe32f0-9a51-4d10-bdd3-a8876d8a2a49 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:30.620961 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-aafe32f0-9a51-4d10-bdd3-a8876d8a2a49 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:30.866989 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-aafe32f0-9a51-4d10-bdd3-a8876d8a2a49 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:08:30.874775 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-aafe32f0-9a51-4d10-bdd3-a8876d8a2a49 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/c2851de3-9ab0-467a-8026-5b44a95c5493" status: 200 len: 1266 microversion: 2.1 time: 0.268605 Sep 16 02:08:30.875337 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 515/1017] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:08:30 2022] GET /compute/v2.1/servers/c2851de3-9ab0-467a-8026-5b44a95c5493 => generated 1266 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:08:31.569124 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [req-1126c191-0485-42d0-8d90-4801cf4422e1 req-3354d78f-158f-460e-be44-853e7c8d086d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2851de3-9ab0-467a-8026-5b44a95c5493", "tag": "3cb201ab-30c6-40a6-9607-59b641eed269"}]} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:08:31.574394 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_api:SELECT=88,nova_api:INSERT=5,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:08:31.582313 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-1126c191-0485-42d0-8d90-4801cf4422e1 req-3354d78f-158f-460e-be44-853e7c8d086d service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:31.582786 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-1126c191-0485-42d0-8d90-4801cf4422e1 req-3354d78f-158f-460e-be44-853e7c8d086d service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:31.583215 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-1126c191-0485-42d0-8d90-4801cf4422e1 req-3354d78f-158f-460e-be44-853e7c8d086d service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:31.598598 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.compute.server_external_events [req-1126c191-0485-42d0-8d90-4801cf4422e1 req-3354d78f-158f-460e-be44-853e7c8d086d service nova] Creating event network-changed:3cb201ab-30c6-40a6-9607-59b641eed269 for instance c2851de3-9ab0-467a-8026-5b44a95c5493 on hv-cinder-84914 Sep 16 02:08:31.604330 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [req-1126c191-0485-42d0-8d90-4801cf4422e1 req-3354d78f-158f-460e-be44-853e7c8d086d service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040201 Sep 16 02:08:31.604913 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 503/1018] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:08:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:08:31.897169 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-f8b63b54-8dda-4afb-b3f4-a4204bed8a85 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:08:31.897785 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-f8b63b54-8dda-4afb-b3f4-a4204bed8a85 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: c2851de3-9ab0-467a-8026-5b44a95c5493] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:08:31.900240 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_api:SELECT=68,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:08:31.905826 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f8b63b54-8dda-4afb-b3f4-a4204bed8a85 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:31.906318 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f8b63b54-8dda-4afb-b3f4-a4204bed8a85 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:31.906760 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f8b63b54-8dda-4afb-b3f4-a4204bed8a85 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:31.907460 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f8b63b54-8dda-4afb-b3f4-a4204bed8a85 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:31.907917 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f8b63b54-8dda-4afb-b3f4-a4204bed8a85 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:31.908369 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f8b63b54-8dda-4afb-b3f4-a4204bed8a85 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:32.125666 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-f8b63b54-8dda-4afb-b3f4-a4204bed8a85 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:08:32.133560 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-f8b63b54-8dda-4afb-b3f4-a4204bed8a85 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/c2851de3-9ab0-467a-8026-5b44a95c5493" status: 200 len: 1266 microversion: 2.1 time: 0.240685 Sep 16 02:08:32.134125 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 516/1019] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:08:31 2022] GET /compute/v2.1/servers/c2851de3-9ab0-467a-8026-5b44a95c5493 => generated 1266 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:08:33.157349 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-8dfd2407-f85c-41d1-9b36-047e1d44eef6 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:08:33.158042 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-8dfd2407-f85c-41d1-9b36-047e1d44eef6 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: c2851de3-9ab0-467a-8026-5b44a95c5493] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:08:33.165205 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8dfd2407-f85c-41d1-9b36-047e1d44eef6 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:33.165694 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8dfd2407-f85c-41d1-9b36-047e1d44eef6 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:33.166129 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8dfd2407-f85c-41d1-9b36-047e1d44eef6 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:33.166812 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8dfd2407-f85c-41d1-9b36-047e1d44eef6 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:33.167263 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8dfd2407-f85c-41d1-9b36-047e1d44eef6 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:33.167686 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-8dfd2407-f85c-41d1-9b36-047e1d44eef6 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:33.297137 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-8dfd2407-f85c-41d1-9b36-047e1d44eef6 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:08:33.305309 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-8dfd2407-f85c-41d1-9b36-047e1d44eef6 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/c2851de3-9ab0-467a-8026-5b44a95c5493" status: 200 len: 1266 microversion: 2.1 time: 0.153093 Sep 16 02:08:33.305878 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 504/1020] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:08:33 2022] GET /compute/v2.1/servers/c2851de3-9ab0-467a-8026-5b44a95c5493 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:08:34.327852 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-338eb508-ae9f-4417-b44f-50b208740d0f tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:08:34.328506 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-338eb508-ae9f-4417-b44f-50b208740d0f tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: c2851de3-9ab0-467a-8026-5b44a95c5493] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:08:34.335463 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-338eb508-ae9f-4417-b44f-50b208740d0f tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:34.336012 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-338eb508-ae9f-4417-b44f-50b208740d0f tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:34.336472 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-338eb508-ae9f-4417-b44f-50b208740d0f tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:34.337157 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-338eb508-ae9f-4417-b44f-50b208740d0f tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:34.337605 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-338eb508-ae9f-4417-b44f-50b208740d0f tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:34.338028 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-338eb508-ae9f-4417-b44f-50b208740d0f tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:34.466705 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-338eb508-ae9f-4417-b44f-50b208740d0f tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:08:34.475269 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-338eb508-ae9f-4417-b44f-50b208740d0f tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/c2851de3-9ab0-467a-8026-5b44a95c5493" status: 200 len: 1266 microversion: 2.1 time: 0.151313 Sep 16 02:08:34.475826 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 517/1021] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:08:34 2022] GET /compute/v2.1/servers/c2851de3-9ab0-467a-8026-5b44a95c5493 => generated 1266 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:08:35.497614 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-f42e5c0a-fbc1-4e64-8744-3addb9b6a494 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:08:35.498470 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-f42e5c0a-fbc1-4e64-8744-3addb9b6a494 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: c2851de3-9ab0-467a-8026-5b44a95c5493] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:08:35.500905 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell0:SELECT=2 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:08:35.501608 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell0:SELECT=14 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:08:35.508061 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f42e5c0a-fbc1-4e64-8744-3addb9b6a494 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:35.508552 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f42e5c0a-fbc1-4e64-8744-3addb9b6a494 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:35.508973 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f42e5c0a-fbc1-4e64-8744-3addb9b6a494 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:35.509648 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f42e5c0a-fbc1-4e64-8744-3addb9b6a494 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:35.510092 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f42e5c0a-fbc1-4e64-8744-3addb9b6a494 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:35.510513 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f42e5c0a-fbc1-4e64-8744-3addb9b6a494 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:35.648195 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-f42e5c0a-fbc1-4e64-8744-3addb9b6a494 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:08:35.655714 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-f42e5c0a-fbc1-4e64-8744-3addb9b6a494 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/c2851de3-9ab0-467a-8026-5b44a95c5493" status: 200 len: 1266 microversion: 2.1 time: 0.162050 Sep 16 02:08:35.656299 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 505/1022] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:08:35 2022] GET /compute/v2.1/servers/c2851de3-9ab0-467a-8026-5b44a95c5493 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:08:36.679448 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-e9506b88-d452-4ff8-9e48-f58493271c0f tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:08:36.680088 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-e9506b88-d452-4ff8-9e48-f58493271c0f tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: c2851de3-9ab0-467a-8026-5b44a95c5493] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:08:36.686690 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e9506b88-d452-4ff8-9e48-f58493271c0f tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:36.687176 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e9506b88-d452-4ff8-9e48-f58493271c0f tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:36.687640 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e9506b88-d452-4ff8-9e48-f58493271c0f tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:36.688366 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e9506b88-d452-4ff8-9e48-f58493271c0f tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:36.688822 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e9506b88-d452-4ff8-9e48-f58493271c0f tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:36.689246 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e9506b88-d452-4ff8-9e48-f58493271c0f tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:36.816992 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-e9506b88-d452-4ff8-9e48-f58493271c0f tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:08:36.824613 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-e9506b88-d452-4ff8-9e48-f58493271c0f tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/c2851de3-9ab0-467a-8026-5b44a95c5493" status: 200 len: 1266 microversion: 2.1 time: 0.149598 Sep 16 02:08:36.825169 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 518/1023] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:08:36 2022] GET /compute/v2.1/servers/c2851de3-9ab0-467a-8026-5b44a95c5493 => generated 1266 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:08:37.846675 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-fa6839be-93f4-4537-abfd-082c7cf4efcd tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:08:37.847300 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-fa6839be-93f4-4537-abfd-082c7cf4efcd tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: c2851de3-9ab0-467a-8026-5b44a95c5493] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:08:37.853903 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-fa6839be-93f4-4537-abfd-082c7cf4efcd tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:37.854451 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-fa6839be-93f4-4537-abfd-082c7cf4efcd tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:37.854901 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-fa6839be-93f4-4537-abfd-082c7cf4efcd tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:37.855581 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-fa6839be-93f4-4537-abfd-082c7cf4efcd tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:37.856096 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-fa6839be-93f4-4537-abfd-082c7cf4efcd tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:37.856518 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-fa6839be-93f4-4537-abfd-082c7cf4efcd tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:37.983476 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-fa6839be-93f4-4537-abfd-082c7cf4efcd tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:08:37.991585 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-fa6839be-93f4-4537-abfd-082c7cf4efcd tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/c2851de3-9ab0-467a-8026-5b44a95c5493" status: 200 len: 1266 microversion: 2.1 time: 0.149166 Sep 16 02:08:37.992191 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 506/1024] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:08:37 2022] GET /compute/v2.1/servers/c2851de3-9ab0-467a-8026-5b44a95c5493 => generated 1266 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:08:39.014762 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-2346e65e-1d1f-4b89-b52f-577f25b4e3fb tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:08:39.015291 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-2346e65e-1d1f-4b89-b52f-577f25b4e3fb tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: c2851de3-9ab0-467a-8026-5b44a95c5493] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:08:39.022645 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2346e65e-1d1f-4b89-b52f-577f25b4e3fb tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:39.023128 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2346e65e-1d1f-4b89-b52f-577f25b4e3fb tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:39.023565 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2346e65e-1d1f-4b89-b52f-577f25b4e3fb tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:39.024282 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2346e65e-1d1f-4b89-b52f-577f25b4e3fb tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:39.024741 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2346e65e-1d1f-4b89-b52f-577f25b4e3fb tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:39.025168 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2346e65e-1d1f-4b89-b52f-577f25b4e3fb tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:39.159570 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-2346e65e-1d1f-4b89-b52f-577f25b4e3fb tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:08:39.167118 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-2346e65e-1d1f-4b89-b52f-577f25b4e3fb tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/c2851de3-9ab0-467a-8026-5b44a95c5493" status: 200 len: 1266 microversion: 2.1 time: 0.156278 Sep 16 02:08:39.167682 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 519/1025] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:08:39 2022] GET /compute/v2.1/servers/c2851de3-9ab0-467a-8026-5b44a95c5493 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:08:40.189423 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-02753b2d-7c9a-4a83-972a-a62e051c46a8 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:08:40.190837 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-02753b2d-7c9a-4a83-972a-a62e051c46a8 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: c2851de3-9ab0-467a-8026-5b44a95c5493] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:08:40.197224 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-02753b2d-7c9a-4a83-972a-a62e051c46a8 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:40.197703 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-02753b2d-7c9a-4a83-972a-a62e051c46a8 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:40.198136 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-02753b2d-7c9a-4a83-972a-a62e051c46a8 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:40.198820 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-02753b2d-7c9a-4a83-972a-a62e051c46a8 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:40.199272 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-02753b2d-7c9a-4a83-972a-a62e051c46a8 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:40.199697 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-02753b2d-7c9a-4a83-972a-a62e051c46a8 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:40.328741 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-02753b2d-7c9a-4a83-972a-a62e051c46a8 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:08:40.337063 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-02753b2d-7c9a-4a83-972a-a62e051c46a8 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/c2851de3-9ab0-467a-8026-5b44a95c5493" status: 200 len: 1266 microversion: 2.1 time: 0.151520 Sep 16 02:08:40.337619 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 507/1026] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:08:40 2022] GET /compute/v2.1/servers/c2851de3-9ab0-467a-8026-5b44a95c5493 => generated 1266 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:08:40.838980 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [req-e8703343-7e9b-4338-83fb-9195b4e37d87 req-18cb1366-2eb2-4b01-9e21-531b12126352 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2851de3-9ab0-467a-8026-5b44a95c5493", "name": "network-vif-plugged", "status": "completed", "tag": "3cb201ab-30c6-40a6-9607-59b641eed269"}]} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:08:40.848727 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-e8703343-7e9b-4338-83fb-9195b4e37d87 req-18cb1366-2eb2-4b01-9e21-531b12126352 service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:40.849366 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-e8703343-7e9b-4338-83fb-9195b4e37d87 req-18cb1366-2eb2-4b01-9e21-531b12126352 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:40.849804 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-e8703343-7e9b-4338-83fb-9195b4e37d87 req-18cb1366-2eb2-4b01-9e21-531b12126352 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:40.861888 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.compute.server_external_events [req-e8703343-7e9b-4338-83fb-9195b4e37d87 req-18cb1366-2eb2-4b01-9e21-531b12126352 service nova] Creating event network-vif-plugged:3cb201ab-30c6-40a6-9607-59b641eed269 for instance c2851de3-9ab0-467a-8026-5b44a95c5493 on hv-cinder-84914 Sep 16 02:08:40.866813 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [req-e8703343-7e9b-4338-83fb-9195b4e37d87 req-18cb1366-2eb2-4b01-9e21-531b12126352 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031576 Sep 16 02:08:40.867687 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 520/1027] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:08:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:08:41.359953 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-dd387ec2-f74f-4a3f-90ab-11a26352ce2c tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:08:41.360588 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-dd387ec2-f74f-4a3f-90ab-11a26352ce2c tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: c2851de3-9ab0-467a-8026-5b44a95c5493] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:08:41.368143 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-dd387ec2-f74f-4a3f-90ab-11a26352ce2c tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:41.368665 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-dd387ec2-f74f-4a3f-90ab-11a26352ce2c tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:41.369107 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-dd387ec2-f74f-4a3f-90ab-11a26352ce2c tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:41.369804 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-dd387ec2-f74f-4a3f-90ab-11a26352ce2c tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:41.370263 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-dd387ec2-f74f-4a3f-90ab-11a26352ce2c tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:41.370692 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-dd387ec2-f74f-4a3f-90ab-11a26352ce2c tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:41.502903 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-dd387ec2-f74f-4a3f-90ab-11a26352ce2c tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:08:41.510678 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-dd387ec2-f74f-4a3f-90ab-11a26352ce2c tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/c2851de3-9ab0-467a-8026-5b44a95c5493" status: 200 len: 1266 microversion: 2.1 time: 0.154654 Sep 16 02:08:41.511249 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 508/1028] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:08:41 2022] GET /compute/v2.1/servers/c2851de3-9ab0-467a-8026-5b44a95c5493 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:08:42.535844 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-7830d276-10ae-479f-b033-919afab37202 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:08:42.537254 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-7830d276-10ae-479f-b033-919afab37202 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: c2851de3-9ab0-467a-8026-5b44a95c5493] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:08:42.544074 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7830d276-10ae-479f-b033-919afab37202 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:42.544636 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7830d276-10ae-479f-b033-919afab37202 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:42.545913 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7830d276-10ae-479f-b033-919afab37202 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:42.546620 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7830d276-10ae-479f-b033-919afab37202 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:42.547084 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7830d276-10ae-479f-b033-919afab37202 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:42.547512 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7830d276-10ae-479f-b033-919afab37202 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:42.684064 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-7830d276-10ae-479f-b033-919afab37202 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:08:42.692588 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-7830d276-10ae-479f-b033-919afab37202 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/c2851de3-9ab0-467a-8026-5b44a95c5493" status: 200 len: 1266 microversion: 2.1 time: 0.163178 Sep 16 02:08:42.693149 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 521/1029] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:08:42 2022] GET /compute/v2.1/servers/c2851de3-9ab0-467a-8026-5b44a95c5493 => generated 1266 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:08:43.715038 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-b4d7389c-2293-4ee6-b32a-7d4c046430dc tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:08:43.715679 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-b4d7389c-2293-4ee6-b32a-7d4c046430dc tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: c2851de3-9ab0-467a-8026-5b44a95c5493] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:08:43.722575 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b4d7389c-2293-4ee6-b32a-7d4c046430dc tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:43.723056 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b4d7389c-2293-4ee6-b32a-7d4c046430dc tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:43.723494 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b4d7389c-2293-4ee6-b32a-7d4c046430dc tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:43.724206 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b4d7389c-2293-4ee6-b32a-7d4c046430dc tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:43.724668 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b4d7389c-2293-4ee6-b32a-7d4c046430dc tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:43.725093 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b4d7389c-2293-4ee6-b32a-7d4c046430dc tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:43.853479 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-b4d7389c-2293-4ee6-b32a-7d4c046430dc tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:08:43.861090 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-b4d7389c-2293-4ee6-b32a-7d4c046430dc tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/c2851de3-9ab0-467a-8026-5b44a95c5493" status: 200 len: 1452 microversion: 2.1 time: 0.149940 Sep 16 02:08:43.861784 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 509/1030] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:08:43 2022] GET /compute/v2.1/servers/c2851de3-9ab0-467a-8026-5b44a95c5493 => generated 1452 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:08:43.883540 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-567b5b45-ee14-4fba-81c2-d0c3ff6d39ec tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:08:43.884203 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-567b5b45-ee14-4fba-81c2-d0c3ff6d39ec tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: c2851de3-9ab0-467a-8026-5b44a95c5493] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:08:43.890548 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-567b5b45-ee14-4fba-81c2-d0c3ff6d39ec tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:43.891034 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-567b5b45-ee14-4fba-81c2-d0c3ff6d39ec tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:43.891472 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-567b5b45-ee14-4fba-81c2-d0c3ff6d39ec tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:43.892192 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-567b5b45-ee14-4fba-81c2-d0c3ff6d39ec tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:43.893290 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-567b5b45-ee14-4fba-81c2-d0c3ff6d39ec tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:43.893718 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-567b5b45-ee14-4fba-81c2-d0c3ff6d39ec tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:44.022359 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-567b5b45-ee14-4fba-81c2-d0c3ff6d39ec tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:08:44.029975 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-567b5b45-ee14-4fba-81c2-d0c3ff6d39ec tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/c2851de3-9ab0-467a-8026-5b44a95c5493" status: 200 len: 1452 microversion: 2.1 time: 0.150300 Sep 16 02:08:44.030533 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 522/1031] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:08:43 2022] GET /compute/v2.1/servers/c2851de3-9ab0-467a-8026-5b44a95c5493 => generated 1452 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:08:45.637790 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [req-a43ab6b0-180d-4148-bf8c-b4dcf2c538f3 req-3188208e-5176-47e2-bf28-cbdcd36d871f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c2851de3-9ab0-467a-8026-5b44a95c5493", "tag": "3cb201ab-30c6-40a6-9607-59b641eed269"}]} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:08:45.648107 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-a43ab6b0-180d-4148-bf8c-b4dcf2c538f3 req-3188208e-5176-47e2-bf28-cbdcd36d871f service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:08:45.648589 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-a43ab6b0-180d-4148-bf8c-b4dcf2c538f3 req-3188208e-5176-47e2-bf28-cbdcd36d871f service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:08:45.649026 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-a43ab6b0-180d-4148-bf8c-b4dcf2c538f3 req-3188208e-5176-47e2-bf28-cbdcd36d871f service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:08:45.660388 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.compute.server_external_events [req-a43ab6b0-180d-4148-bf8c-b4dcf2c538f3 req-3188208e-5176-47e2-bf28-cbdcd36d871f service nova] Creating event network-changed:3cb201ab-30c6-40a6-9607-59b641eed269 for instance c2851de3-9ab0-467a-8026-5b44a95c5493 on hv-cinder-84914 Sep 16 02:08:45.665315 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [req-a43ab6b0-180d-4148-bf8c-b4dcf2c538f3 req-3188208e-5176-47e2-bf28-cbdcd36d871f service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031277 Sep 16 02:08:45.665907 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 510/1032] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:09:44.564744 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_api:SELECT=13 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:09:44.565481 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell1:SELECT=60 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:09:44.624879 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-b59eb998-c584-4e27-bb04-7ac683f2d29a tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:09:44.625367 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-b59eb998-c584-4e27-bb04-7ac683f2d29a tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: a3d82b31-1f43-429e-84a1-483acae4dbac] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:09:44.631831 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b59eb998-c584-4e27-bb04-7ac683f2d29a tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:09:44.632343 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b59eb998-c584-4e27-bb04-7ac683f2d29a tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:09:44.632774 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b59eb998-c584-4e27-bb04-7ac683f2d29a tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:09:44.633457 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b59eb998-c584-4e27-bb04-7ac683f2d29a tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:09:44.633937 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b59eb998-c584-4e27-bb04-7ac683f2d29a tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:09:44.634356 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b59eb998-c584-4e27-bb04-7ac683f2d29a tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:09:44.657551 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-b59eb998-c584-4e27-bb04-7ac683f2d29a tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/a3d82b31-1f43-429e-84a1-483acae4dbac/ips" status: 200 len: 149 microversion: 2.1 time: 0.094866 Sep 16 02:09:44.658644 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 523/1033] 10.222.0.42 () {58 vars in 1248 bytes} [Fri Sep 16 02:09:44 2022] GET /compute/v2.1/servers/a3d82b31-1f43-429e-84a1-483acae4dbac/ips => generated 149 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:09:45.997458 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_api:SELECT=15 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:09:45.998455 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell1:SELECT=40 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:09:46.004100 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-377a4f48-007e-43e8-b412-757d507c0e64 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "247abc38-dd6e-4849-897a-6cbb580a5152"}} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:09:46.006572 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-377a4f48-007e-43e8-b412-757d507c0e64 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: a3d82b31-1f43-429e-84a1-483acae4dbac] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:09:46.013920 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-377a4f48-007e-43e8-b412-757d507c0e64 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:09:46.014451 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-377a4f48-007e-43e8-b412-757d507c0e64 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:09:46.014935 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-377a4f48-007e-43e8-b412-757d507c0e64 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:09:46.015630 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-377a4f48-007e-43e8-b412-757d507c0e64 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:09:46.016426 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-377a4f48-007e-43e8-b412-757d507c0e64 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:09:46.016540 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-377a4f48-007e-43e8-b412-757d507c0e64 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:09:46.379982 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-377a4f48-007e-43e8-b412-757d507c0e64 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "POST /compute/v2.1/servers/a3d82b31-1f43-429e-84a1-483acae4dbac/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.384365 Sep 16 02:09:46.386017 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 511/1034] 10.222.0.42 () {60 vars in 1323 bytes} [Fri Sep 16 02:09:45 2022] POST /compute/v2.1/servers/a3d82b31-1f43-429e-84a1-483acae4dbac/os-volume_attachments => generated 194 bytes in 386 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:09:53.925067 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-4267cb31-8999-4132-b567-391c5cad9a63 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "247abc38-dd6e-4849-897a-6cbb580a5152"}} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:09:53.927451 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-4267cb31-8999-4132-b567-391c5cad9a63 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: a3d82b31-1f43-429e-84a1-483acae4dbac] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:09:53.933905 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4267cb31-8999-4132-b567-391c5cad9a63 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:09:53.934382 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4267cb31-8999-4132-b567-391c5cad9a63 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:09:53.934813 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4267cb31-8999-4132-b567-391c5cad9a63 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:09:53.935487 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4267cb31-8999-4132-b567-391c5cad9a63 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:09:53.935945 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4267cb31-8999-4132-b567-391c5cad9a63 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:09:53.936391 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4267cb31-8999-4132-b567-391c5cad9a63 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:09:54.062645 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.wsgi [None req-4267cb31-8999-4132-b567-391c5cad9a63 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] HTTP exception thrown: Invalid volume: volume 247abc38-dd6e-4849-897a-6cbb580a5152 is already attached to instances: a3d82b31-1f43-429e-84a1-483acae4dbac Sep 16 02:09:54.064993 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-4267cb31-8999-4132-b567-391c5cad9a63 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Request method failure captured: Sep 16 02:09:54.064993 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: request: POST /compute/v2.1/servers/a3d82b31-1f43-429e-84a1-483acae4dbac/os-volume_attachments HTTP/1.1 Sep 16 02:09:54.064993 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Accept: application/json Sep 16 02:09:54.064993 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Accept-Encoding: identity Sep 16 02:09:54.064993 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Connection: close Sep 16 02:09:54.064993 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Content-Length: 74 Sep 16 02:09:54.064993 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Content-Type: application/json Sep 16 02:09:54.064993 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Host: 10.222.0.42 Sep 16 02:09:54.064993 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Openstack-System-Scope: None Sep 16 02:09:54.064993 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: User-Agent: python-urllib3/1.26.12 Sep 16 02:09:54.064993 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Auth-Token: gAAAAABjI9mx6m5YD-VfbXTdOVSmd4NGFLNahGaBbLMo1peJ92wbDVmYwuc5RZgaFUZEqbCVEZU6kOmxNdBXGglNvRlzGtU8he2rrBc7XBc5oNHv9HVVP2iJXpOeBFUkIrXZgk5pRb1fDXNxk7RrwhUPrzMT1uDUBmKj9juzpqGuTgd9rytxkwc Sep 16 02:09:54.064993 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Domain-Id: None Sep 16 02:09:54.064993 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Domain-Name: None Sep 16 02:09:54.064993 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Identity-Status: Confirmed Sep 16 02:09:54.064993 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Is-Admin-Project: True Sep 16 02:09:54.064993 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Domain-Id: default Sep 16 02:09:54.064993 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Domain-Name: Default Sep 16 02:09:54.064993 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Id: 663bde66131d47159ffa09ad33971895 Sep 16 02:09:54.064993 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Name: tempest-AttachVolumeNegativeTest-651370638 Sep 16 02:09:54.064993 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Role: member,reader Sep 16 02:09:54.064993 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Roles: member,reader Sep 16 02:09:54.067350 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/663bde66131d47159ffa09ad33971895"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/663bde66131d47159ffa09ad33971895"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_663bde66131d47159ffa09ad33971895"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/663bde66131d47159ffa09ad33971895"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 02:09:54.067350 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant: tempest-AttachVolumeNegativeTest-651370638 Sep 16 02:09:54.067350 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant-Id: 663bde66131d47159ffa09ad33971895 Sep 16 02:09:54.067350 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-651370638 Sep 16 02:09:54.067350 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User: tempest-AttachVolumeNegativeTest-651370638-project Sep 16 02:09:54.067350 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Domain-Id: default Sep 16 02:09:54.067350 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Domain-Name: Default Sep 16 02:09:54.067350 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Id: 86bc1b5163f4453db4469fef90f27344 Sep 16 02:09:54.067350 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Name: tempest-AttachVolumeNegativeTest-651370638-project Sep 16 02:09:54.067350 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Sep 16 02:09:54.067350 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: {"volumeAttachment": {"volumeId": "247abc38-dd6e-4849-897a-6cbb580a5152"}} Sep 16 02:09:54.067350 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: method: > Sep 16 02:09:54.068243 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: exception: Invalid volume: volume 247abc38-dd6e-4849-897a-6cbb580a5152 is already attached to instances: a3d82b31-1f43-429e-84a1-483acae4dbac Sep 16 02:09:54.068243 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: action_args: {'server_id': 'a3d82b31-1f43-429e-84a1-483acae4dbac', 'body': {'volumeAttachment': {'volumeId': '247abc38-dd6e-4849-897a-6cbb580a5152'}}} Sep 16 02:09:54.068243 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 02:09:54.068243 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:09:54.068243 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 16 02:09:54.068243 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 16 02:09:54.068243 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 16 02:09:54.068243 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 16 02:09:54.068243 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 16 02:09:54.068243 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 16 02:09:54.068243 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 16 02:09:54.068243 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 16 02:09:54.068243 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 16 02:09:54.068243 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 16 02:09:54.068243 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 247abc38-dd6e-4849-897a-6cbb580a5152 is already attached to instances: a3d82b31-1f43-429e-84a1-483acae4dbac Sep 16 02:09:54.068243 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:09:54.068243 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:09:54.068243 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:09:54.068243 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:09:54.069598 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:09:54.069598 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:09:54.069598 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 02:09:54.069598 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 02:09:54.069598 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 02:09:54.069598 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 02:09:54.069598 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 02:09:54.069598 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 02:09:54.069598 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 02:09:54.069598 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 02:09:54.069598 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 02:09:54.069598 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 02:09:54.069598 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 16 02:09:54.069598 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 16 02:09:54.069598 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 247abc38-dd6e-4849-897a-6cbb580a5152 is already attached to instances: a3d82b31-1f43-429e-84a1-483acae4dbac Sep 16 02:09:54.069598 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:09:54.069598 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:09:54.069598 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:09:54.069598 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:09:54.069598 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:09:54.070930 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:09:54.070930 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 02:09:54.070930 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 02:09:54.070930 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 247abc38-dd6e-4849-897a-6cbb580a5152 is already attached to instances: a3d82b31-1f43-429e-84a1-483acae4dbac Sep 16 02:09:54.070930 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:09:54.070930 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-4267cb31-8999-4132-b567-391c5cad9a63 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Returning 400 to user: Invalid volume: volume 247abc38-dd6e-4849-897a-6cbb580a5152 is already attached to instances: a3d82b31-1f43-429e-84a1-483acae4dbac {{(pid=120441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 02:09:54.070930 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-4267cb31-8999-4132-b567-391c5cad9a63 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "POST /compute/v2.1/servers/a3d82b31-1f43-429e-84a1-483acae4dbac/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.145427 Sep 16 02:09:54.070930 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 524/1035] 10.222.0.42 () {60 vars in 1323 bytes} [Fri Sep 16 02:09:53 2022] POST /compute/v2.1/servers/a3d82b31-1f43-429e-84a1-483acae4dbac/os-volume_attachments => generated 174 bytes in 146 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 02:09:54.134374 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-b32f4094-eaaf-437d-b009-a697915adfb9 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:09:54.134953 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-b32f4094-eaaf-437d-b009-a697915adfb9 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: a3d82b31-1f43-429e-84a1-483acae4dbac] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:09:54.141046 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b32f4094-eaaf-437d-b009-a697915adfb9 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:09:54.141531 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b32f4094-eaaf-437d-b009-a697915adfb9 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:09:54.142529 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b32f4094-eaaf-437d-b009-a697915adfb9 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:09:54.143217 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b32f4094-eaaf-437d-b009-a697915adfb9 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:09:54.143671 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b32f4094-eaaf-437d-b009-a697915adfb9 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:09:54.144136 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b32f4094-eaaf-437d-b009-a697915adfb9 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:09:54.222581 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.objects.instance [None req-b32f4094-eaaf-437d-b009-a697915adfb9 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lazy-loading 'services' on Instance uuid a3d82b31-1f43-429e-84a1-483acae4dbac {{(pid=120440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 02:09:54.293138 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-b32f4094-eaaf-437d-b009-a697915adfb9 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a3d82b31-1f43-429e-84a1-483acae4dbac/os-volume_attachments/247abc38-dd6e-4849-897a-6cbb580a5152" status: 202 len: 0 microversion: 2.1 time: 0.163289 Sep 16 02:09:54.293721 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 512/1036] 10.222.0.42 () {58 vars in 1416 bytes} [Fri Sep 16 02:09:54 2022] DELETE /compute/v2.1/servers/a3d82b31-1f43-429e-84a1-483acae4dbac/os-volume_attachments/247abc38-dd6e-4849-897a-6cbb580a5152 => generated 0 bytes in 165 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 02:09:54.303222 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-3eaa2e48-da63-4fa3-8dac-d2a214a4bc23 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:09:54.305379 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-3eaa2e48-da63-4fa3-8dac-d2a214a4bc23 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: a3d82b31-1f43-429e-84a1-483acae4dbac] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:09:54.312161 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3eaa2e48-da63-4fa3-8dac-d2a214a4bc23 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:09:54.312632 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3eaa2e48-da63-4fa3-8dac-d2a214a4bc23 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:09:54.313212 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3eaa2e48-da63-4fa3-8dac-d2a214a4bc23 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:09:54.314708 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3eaa2e48-da63-4fa3-8dac-d2a214a4bc23 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:09:54.315346 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3eaa2e48-da63-4fa3-8dac-d2a214a4bc23 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:09:54.315852 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3eaa2e48-da63-4fa3-8dac-d2a214a4bc23 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:09:54.344605 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-3eaa2e48-da63-4fa3-8dac-d2a214a4bc23 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/a3d82b31-1f43-429e-84a1-483acae4dbac/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045758 Sep 16 02:09:54.345454 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 525/1037] 10.222.0.42 () {58 vars in 1302 bytes} [Fri Sep 16 02:09:54 2022] GET /compute/v2.1/servers/a3d82b31-1f43-429e-84a1-483acae4dbac/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:09:55.358420 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-c08af0be-5d49-4b6b-a3e7-8f56e15bb26c tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:09:55.360911 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-c08af0be-5d49-4b6b-a3e7-8f56e15bb26c tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: a3d82b31-1f43-429e-84a1-483acae4dbac] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:09:55.367095 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c08af0be-5d49-4b6b-a3e7-8f56e15bb26c tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:09:55.367580 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c08af0be-5d49-4b6b-a3e7-8f56e15bb26c tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:09:55.368061 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c08af0be-5d49-4b6b-a3e7-8f56e15bb26c tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:09:55.368752 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c08af0be-5d49-4b6b-a3e7-8f56e15bb26c tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:09:55.369209 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c08af0be-5d49-4b6b-a3e7-8f56e15bb26c tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:09:55.369636 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-c08af0be-5d49-4b6b-a3e7-8f56e15bb26c tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:09:55.399673 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-c08af0be-5d49-4b6b-a3e7-8f56e15bb26c tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/a3d82b31-1f43-429e-84a1-483acae4dbac/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046078 Sep 16 02:09:55.400261 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 513/1038] 10.222.0.42 () {58 vars in 1302 bytes} [Fri Sep 16 02:09:55 2022] GET /compute/v2.1/servers/a3d82b31-1f43-429e-84a1-483acae4dbac/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 02:09:55.463058 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-6cca056c-facd-4ad5-b818-48fc0d3bf860 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:09:55.463565 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-6cca056c-facd-4ad5-b818-48fc0d3bf860 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: a3d82b31-1f43-429e-84a1-483acae4dbac] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:09:55.470463 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-6cca056c-facd-4ad5-b818-48fc0d3bf860 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:09:55.470945 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-6cca056c-facd-4ad5-b818-48fc0d3bf860 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:09:55.471412 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-6cca056c-facd-4ad5-b818-48fc0d3bf860 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:09:55.472159 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-6cca056c-facd-4ad5-b818-48fc0d3bf860 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:09:55.472615 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-6cca056c-facd-4ad5-b818-48fc0d3bf860 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:09:55.473040 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-6cca056c-facd-4ad5-b818-48fc0d3bf860 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:09:55.497756 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-6cca056c-facd-4ad5-b818-48fc0d3bf860 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: a3d82b31-1f43-429e-84a1-483acae4dbac] Going to try to terminate instance {{(pid=120441) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 02:09:55.575755 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-6cca056c-facd-4ad5-b818-48fc0d3bf860 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a3d82b31-1f43-429e-84a1-483acae4dbac" status: 204 len: 0 microversion: 2.1 time: 0.116277 Sep 16 02:09:55.576431 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 526/1039] 10.222.0.42 () {58 vars in 1239 bytes} [Fri Sep 16 02:09:55 2022] DELETE /compute/v2.1/servers/a3d82b31-1f43-429e-84a1-483acae4dbac => generated 0 bytes in 118 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 02:09:55.586140 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-6fc3f044-96aa-418a-9c66-bc0cf0e17040 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:09:55.586861 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-6fc3f044-96aa-418a-9c66-bc0cf0e17040 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: a3d82b31-1f43-429e-84a1-483acae4dbac] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:09:55.592657 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6fc3f044-96aa-418a-9c66-bc0cf0e17040 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:09:55.593144 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6fc3f044-96aa-418a-9c66-bc0cf0e17040 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:09:55.593563 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6fc3f044-96aa-418a-9c66-bc0cf0e17040 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:09:55.594235 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6fc3f044-96aa-418a-9c66-bc0cf0e17040 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:09:55.595317 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6fc3f044-96aa-418a-9c66-bc0cf0e17040 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:09:55.595873 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6fc3f044-96aa-418a-9c66-bc0cf0e17040 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:09:55.728470 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-6fc3f044-96aa-418a-9c66-bc0cf0e17040 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:09:55.736582 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-6fc3f044-96aa-418a-9c66-bc0cf0e17040 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/a3d82b31-1f43-429e-84a1-483acae4dbac" status: 200 len: 1679 microversion: 2.1 time: 0.155192 Sep 16 02:09:55.737143 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 514/1040] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:09:55 2022] GET /compute/v2.1/servers/a3d82b31-1f43-429e-84a1-483acae4dbac => generated 1679 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 02:09:56.761846 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-f6ccfec8-d6b0-435b-8eff-291897429510 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:09:56.762539 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-f6ccfec8-d6b0-435b-8eff-291897429510 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: a3d82b31-1f43-429e-84a1-483acae4dbac] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:09:56.769474 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f6ccfec8-d6b0-435b-8eff-291897429510 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:09:56.769957 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f6ccfec8-d6b0-435b-8eff-291897429510 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:09:56.770386 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f6ccfec8-d6b0-435b-8eff-291897429510 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:09:56.771061 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f6ccfec8-d6b0-435b-8eff-291897429510 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:09:56.771505 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f6ccfec8-d6b0-435b-8eff-291897429510 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:09:56.771919 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f6ccfec8-d6b0-435b-8eff-291897429510 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:09:56.903896 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-f6ccfec8-d6b0-435b-8eff-291897429510 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:09:56.913268 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-f6ccfec8-d6b0-435b-8eff-291897429510 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/a3d82b31-1f43-429e-84a1-483acae4dbac" status: 200 len: 1679 microversion: 2.1 time: 0.155734 Sep 16 02:09:56.913833 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 527/1041] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:09:56 2022] GET /compute/v2.1/servers/a3d82b31-1f43-429e-84a1-483acae4dbac => generated 1679 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:09:57.936701 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-67bc34ec-e249-4c6a-97ae-a6f264c535c5 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:09:57.937500 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-67bc34ec-e249-4c6a-97ae-a6f264c535c5 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: a3d82b31-1f43-429e-84a1-483acae4dbac] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:09:57.944967 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-67bc34ec-e249-4c6a-97ae-a6f264c535c5 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:09:57.945492 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-67bc34ec-e249-4c6a-97ae-a6f264c535c5 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:09:57.945935 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-67bc34ec-e249-4c6a-97ae-a6f264c535c5 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:09:57.946635 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-67bc34ec-e249-4c6a-97ae-a6f264c535c5 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:09:57.947085 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-67bc34ec-e249-4c6a-97ae-a6f264c535c5 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:09:57.947551 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-67bc34ec-e249-4c6a-97ae-a6f264c535c5 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:09:58.081937 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-67bc34ec-e249-4c6a-97ae-a6f264c535c5 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:09:58.089622 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-67bc34ec-e249-4c6a-97ae-a6f264c535c5 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/a3d82b31-1f43-429e-84a1-483acae4dbac" status: 200 len: 1679 microversion: 2.1 time: 0.156848 Sep 16 02:09:58.090179 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 515/1042] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:09:57 2022] GET /compute/v2.1/servers/a3d82b31-1f43-429e-84a1-483acae4dbac => generated 1679 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:09:58.798157 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [req-138265fb-8d27-4a9f-8827-a3d8366696fb req-797190a9-4759-4ea3-866d-eb3555cf99b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a3d82b31-1f43-429e-84a1-483acae4dbac", "name": "network-vif-deleted", "tag": "5a10d469-3480-4bed-8934-5fbc18a639f7"}]} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:09:58.816703 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-138265fb-8d27-4a9f-8827-a3d8366696fb req-797190a9-4759-4ea3-866d-eb3555cf99b0 service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:09:58.817108 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-138265fb-8d27-4a9f-8827-a3d8366696fb req-797190a9-4759-4ea3-866d-eb3555cf99b0 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:09:58.817536 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-138265fb-8d27-4a9f-8827-a3d8366696fb req-797190a9-4759-4ea3-866d-eb3555cf99b0 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:09:58.829196 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.compute.server_external_events [req-138265fb-8d27-4a9f-8827-a3d8366696fb req-797190a9-4759-4ea3-866d-eb3555cf99b0 service nova] Creating event network-vif-deleted:5a10d469-3480-4bed-8934-5fbc18a639f7 for instance a3d82b31-1f43-429e-84a1-483acae4dbac on hv-cinder-84914 Sep 16 02:09:58.838315 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [req-138265fb-8d27-4a9f-8827-a3d8366696fb req-797190a9-4759-4ea3-866d-eb3555cf99b0 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.103271 Sep 16 02:09:58.839300 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 528/1043] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:09:58 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 02:09:59.114740 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-1d974604-bb03-4d3c-aa07-f72b5ba26a10 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:09:59.115388 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-1d974604-bb03-4d3c-aa07-f72b5ba26a10 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: a3d82b31-1f43-429e-84a1-483acae4dbac] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:09:59.121754 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1d974604-bb03-4d3c-aa07-f72b5ba26a10 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:09:59.122236 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1d974604-bb03-4d3c-aa07-f72b5ba26a10 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:09:59.122937 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1d974604-bb03-4d3c-aa07-f72b5ba26a10 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:09:59.123659 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1d974604-bb03-4d3c-aa07-f72b5ba26a10 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:09:59.124141 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1d974604-bb03-4d3c-aa07-f72b5ba26a10 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:09:59.124570 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1d974604-bb03-4d3c-aa07-f72b5ba26a10 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:09:59.155428 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1d974604-bb03-4d3c-aa07-f72b5ba26a10 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:09:59.155910 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1d974604-bb03-4d3c-aa07-f72b5ba26a10 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:09:59.156375 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1d974604-bb03-4d3c-aa07-f72b5ba26a10 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:09:59.156839 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.objects.instance [None req-1d974604-bb03-4d3c-aa07-f72b5ba26a10 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lazy-loading 'fault' on Instance uuid a3d82b31-1f43-429e-84a1-483acae4dbac {{(pid=120440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 02:09:59.197270 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-1d974604-bb03-4d3c-aa07-f72b5ba26a10 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:09:59.210380 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-1d974604-bb03-4d3c-aa07-f72b5ba26a10 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/a3d82b31-1f43-429e-84a1-483acae4dbac" status: 200 len: 1330 microversion: 2.1 time: 0.100134 Sep 16 02:09:59.210980 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 516/1044] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:09:59 2022] GET /compute/v2.1/servers/a3d82b31-1f43-429e-84a1-483acae4dbac => generated 1330 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:10:00.234955 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-baf5dfca-be37-4d52-a06f-a1cf8e4907ff tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:10:00.236545 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-baf5dfca-be37-4d52-a06f-a1cf8e4907ff tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: a3d82b31-1f43-429e-84a1-483acae4dbac] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:10:00.242598 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-baf5dfca-be37-4d52-a06f-a1cf8e4907ff tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:10:00.243077 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-baf5dfca-be37-4d52-a06f-a1cf8e4907ff tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:10:00.243514 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-baf5dfca-be37-4d52-a06f-a1cf8e4907ff tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:10:00.244218 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-baf5dfca-be37-4d52-a06f-a1cf8e4907ff tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:10:00.244670 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-baf5dfca-be37-4d52-a06f-a1cf8e4907ff tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:10:00.245093 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-baf5dfca-be37-4d52-a06f-a1cf8e4907ff tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:10:00.258760 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.wsgi [None req-baf5dfca-be37-4d52-a06f-a1cf8e4907ff tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] HTTP exception thrown: Instance a3d82b31-1f43-429e-84a1-483acae4dbac could not be found. Sep 16 02:10:00.260391 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-baf5dfca-be37-4d52-a06f-a1cf8e4907ff tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Request method failure captured: Sep 16 02:10:00.260391 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: request: GET /compute/v2.1/servers/a3d82b31-1f43-429e-84a1-483acae4dbac HTTP/1.1 Sep 16 02:10:00.260391 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Accept: application/json Sep 16 02:10:00.260391 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Accept-Encoding: identity Sep 16 02:10:00.260391 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Connection: close Sep 16 02:10:00.260391 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Content-Length: 0 Sep 16 02:10:00.260391 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Content-Type: application/json Sep 16 02:10:00.260391 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Host: 10.222.0.42 Sep 16 02:10:00.260391 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Openstack-System-Scope: None Sep 16 02:10:00.260391 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: User-Agent: python-urllib3/1.26.12 Sep 16 02:10:00.260391 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Auth-Token: gAAAAABjI9mx6m5YD-VfbXTdOVSmd4NGFLNahGaBbLMo1peJ92wbDVmYwuc5RZgaFUZEqbCVEZU6kOmxNdBXGglNvRlzGtU8he2rrBc7XBc5oNHv9HVVP2iJXpOeBFUkIrXZgk5pRb1fDXNxk7RrwhUPrzMT1uDUBmKj9juzpqGuTgd9rytxkwc Sep 16 02:10:00.260391 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Domain-Id: None Sep 16 02:10:00.260391 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Domain-Name: None Sep 16 02:10:00.260391 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Identity-Status: Confirmed Sep 16 02:10:00.260391 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Is-Admin-Project: True Sep 16 02:10:00.260391 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Domain-Id: default Sep 16 02:10:00.260391 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Domain-Name: Default Sep 16 02:10:00.260391 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Id: 663bde66131d47159ffa09ad33971895 Sep 16 02:10:00.260391 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Name: tempest-AttachVolumeNegativeTest-651370638 Sep 16 02:10:00.260391 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Role: member,reader Sep 16 02:10:00.260391 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Roles: member,reader Sep 16 02:10:00.262168 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/663bde66131d47159ffa09ad33971895"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/663bde66131d47159ffa09ad33971895"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_663bde66131d47159ffa09ad33971895"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/663bde66131d47159ffa09ad33971895"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 02:10:00.262168 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant: tempest-AttachVolumeNegativeTest-651370638 Sep 16 02:10:00.262168 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant-Id: 663bde66131d47159ffa09ad33971895 Sep 16 02:10:00.262168 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-651370638 Sep 16 02:10:00.262168 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User: tempest-AttachVolumeNegativeTest-651370638-project Sep 16 02:10:00.262168 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Domain-Id: default Sep 16 02:10:00.262168 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Domain-Name: Default Sep 16 02:10:00.262168 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Id: 86bc1b5163f4453db4469fef90f27344 Sep 16 02:10:00.262168 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Name: tempest-AttachVolumeNegativeTest-651370638-project Sep 16 02:10:00.262168 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: method: > Sep 16 02:10:00.262168 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: exception: Instance a3d82b31-1f43-429e-84a1-483acae4dbac could not be found. Sep 16 02:10:00.262168 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: action_args: {'id': 'a3d82b31-1f43-429e-84a1-483acae4dbac'} Sep 16 02:10:00.263111 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 02:10:00.263111 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:10:00.263111 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 02:10:00.263111 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 02:10:00.263111 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 02:10:00.263111 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 02:10:00.263111 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 02:10:00.263111 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 02:10:00.263111 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 02:10:00.263111 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 02:10:00.263111 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3d82b31-1f43-429e-84a1-483acae4dbac could not be found. Sep 16 02:10:00.263111 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:10:00.263111 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:10:00.263111 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:10:00.263111 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:10:00.263111 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:10:00.263111 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:10:00.263111 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 02:10:00.263111 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 02:10:00.263111 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 02:10:00.264715 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 02:10:00.264715 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 02:10:00.264715 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 02:10:00.264715 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 02:10:00.264715 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 02:10:00.264715 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 02:10:00.264715 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 02:10:00.264715 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3d82b31-1f43-429e-84a1-483acae4dbac could not be found. Sep 16 02:10:00.264715 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:10:00.264715 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:10:00.264715 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:10:00.264715 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:10:00.264715 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:10:00.264715 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:10:00.264715 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 02:10:00.264715 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 02:10:00.264715 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3d82b31-1f43-429e-84a1-483acae4dbac could not be found. Sep 16 02:10:00.264715 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:10:00.266190 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-baf5dfca-be37-4d52-a06f-a1cf8e4907ff tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Returning 404 to user: Instance a3d82b31-1f43-429e-84a1-483acae4dbac could not be found. {{(pid=120441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 02:10:00.266190 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-baf5dfca-be37-4d52-a06f-a1cf8e4907ff tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/a3d82b31-1f43-429e-84a1-483acae4dbac" status: 404 len: 111 microversion: 2.1 time: 0.031556 Sep 16 02:10:00.266190 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 529/1045] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:10:00 2022] GET /compute/v2.1/servers/a3d82b31-1f43-429e-84a1-483acae4dbac => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 02:10:00.270746 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-ebe2f95e-8808-4434-bfdb-eb32d693bae4 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '.version_select at 0x7fae32a781f0>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:10:00.289887 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-ebe2f95e-8808-4434-bfdb-eb32d693bae4 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-931151170" status: 202 len: 0 microversion: 2.1 time: 0.023048 Sep 16 02:10:00.290445 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 517/1046] 10.222.0.42 () {58 vars in 1218 bytes} [Fri Sep 16 02:10:00 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-931151170 => generated 0 bytes in 24 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 02:10:00.898252 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-96ca8d54-8183-4273-8f03-fbd7aab242ab tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Action: 'create', calling method: .version_select at 0x7fae3627a0d0>, body: {"keypair": {"name": "tempest-keypair-643125845", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPxHukZ8UQBZlcy2D7WFG69GJMI8VmFqTXRV5c5H2N0btyvQBtGx0D3ThRzsSQrcP1P3dU0AaF5FD7EpvSmhz8bVlapQMZj3JNjUQ8IVbUBkHluDFWMMuwrlp6pzhQmXIw=="}} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:10:00.913178 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.quota [None req-96ca8d54-8183-4273-8f03-fbd7aab242ab tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Getting quotas for project 663bde66131d47159ffa09ad33971895. Resources: {'key_pairs'} {{(pid=120441) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 02:10:00.916971 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.quota [None req-96ca8d54-8183-4273-8f03-fbd7aab242ab tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Getting quotas for user 86bc1b5163f4453db4469fef90f27344 and project 663bde66131d47159ffa09ad33971895. Resources: {'key_pairs'} {{(pid=120441) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 02:10:00.939056 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-96ca8d54-8183-4273-8f03-fbd7aab242ab tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.044170 Sep 16 02:10:00.939636 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 530/1047] 10.222.0.42 () {60 vars in 1159 bytes} [Fri Sep 16 02:10:00 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:10:02.132744 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-21f4e328-3f05-41d3-8c09-e1f61b208329 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1483782526", "imageRef": "1546da04-912c-44c6-b4b9-34fba35e08f6", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "80b93367-5ee2-4183-922b-cb2be17dc7b7"}], "security_groups": [{"name": "tempest-securitygroup--135902070"}], "key_name": "tempest-keypair-643125845", "user_data": "}} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:10:02.238013 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.network.neutron [None req-21f4e328-3f05-41d3-8c09-e1f61b208329 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] validate_networks() for [('80b93367-5ee2-4183-922b-cb2be17dc7b7', None, None, None, None, None)] {{(pid=120440) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 02:10:02.598595 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.virt.hardware [None req-21f4e328-3f05-41d3-8c09-e1f61b208329 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Flavor limits 0:0:0 {{(pid=120440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 02:10:02.599071 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.virt.hardware [None req-21f4e328-3f05-41d3-8c09-e1f61b208329 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Image limits 0:0:0 {{(pid=120440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 02:10:02.599527 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.virt.hardware [None req-21f4e328-3f05-41d3-8c09-e1f61b208329 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Flavor pref 0:0:0 {{(pid=120440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 02:10:02.599953 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.virt.hardware [None req-21f4e328-3f05-41d3-8c09-e1f61b208329 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Image pref 0:0:0 {{(pid=120440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 02:10:02.600365 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.virt.hardware [None req-21f4e328-3f05-41d3-8c09-e1f61b208329 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 02:10:02.609025 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-21f4e328-3f05-41d3-8c09-e1f61b208329 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:10:02.609503 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-21f4e328-3f05-41d3-8c09-e1f61b208329 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:10:02.610458 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-21f4e328-3f05-41d3-8c09-e1f61b208329 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:10:02.611176 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-21f4e328-3f05-41d3-8c09-e1f61b208329 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:10:02.611627 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-21f4e328-3f05-41d3-8c09-e1f61b208329 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:10:02.612086 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-21f4e328-3f05-41d3-8c09-e1f61b208329 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:10:02.629580 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.quota [None req-21f4e328-3f05-41d3-8c09-e1f61b208329 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Getting quotas for project 663bde66131d47159ffa09ad33971895. Resources: {'cores', 'ram', 'instances'} {{(pid=120440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 02:10:02.633476 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.quota [None req-21f4e328-3f05-41d3-8c09-e1f61b208329 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Getting quotas for user 86bc1b5163f4453db4469fef90f27344 and project 663bde66131d47159ffa09ad33971895. Resources: {'cores', 'ram', 'instances'} {{(pid=120440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 02:10:02.649187 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-21f4e328-3f05-41d3-8c09-e1f61b208329 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Going to run 1 instances... {{(pid=120440) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 02:10:02.651456 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-21f4e328-3f05-41d3-8c09-e1f61b208329 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='1546da04-912c-44c6-b4b9-34fba35e08f6',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=120440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 02:10:02.700419 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-21f4e328-3f05-41d3-8c09-e1f61b208329 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.572096 Sep 16 02:10:02.701056 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 518/1048] 10.222.0.42 () {60 vars in 1147 bytes} [Fri Sep 16 02:10:02 2022] POST /compute/v2.1/servers => generated 401 bytes in 573 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 02:10:02.712985 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-cac60e45-7b9a-4dd5-b8c7-7eba24e01f4c tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:10:02.713647 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-cac60e45-7b9a-4dd5-b8c7-7eba24e01f4c tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:10:02.769709 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-cac60e45-7b9a-4dd5-b8c7-7eba24e01f4c tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:10:02.776505 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-cac60e45-7b9a-4dd5-b8c7-7eba24e01f4c tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b" status: 200 len: 1241 microversion: 2.1 time: 0.067868 Sep 16 02:10:02.777056 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 531/1049] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:10:02 2022] GET /compute/v2.1/servers/b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b => generated 1241 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:10:03.800123 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-9b9991f8-d07f-4338-a0d0-e7ede972ee80 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:10:03.801344 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-9b9991f8-d07f-4338-a0d0-e7ede972ee80 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:10:03.808283 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9b9991f8-d07f-4338-a0d0-e7ede972ee80 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:10:03.809023 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9b9991f8-d07f-4338-a0d0-e7ede972ee80 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:10:03.809627 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9b9991f8-d07f-4338-a0d0-e7ede972ee80 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:10:03.810498 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9b9991f8-d07f-4338-a0d0-e7ede972ee80 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:10:03.811797 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9b9991f8-d07f-4338-a0d0-e7ede972ee80 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:10:03.812428 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-9b9991f8-d07f-4338-a0d0-e7ede972ee80 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:10:03.879752 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-9b9991f8-d07f-4338-a0d0-e7ede972ee80 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:10:03.887916 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-9b9991f8-d07f-4338-a0d0-e7ede972ee80 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b" status: 200 len: 1311 microversion: 2.1 time: 0.091948 Sep 16 02:10:03.888524 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 519/1050] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:10:03 2022] GET /compute/v2.1/servers/b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b => generated 1311 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:10:04.911284 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-67cdbc58-7b10-4107-aaf8-d12c1c5fd463 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:10:04.911952 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-67cdbc58-7b10-4107-aaf8-d12c1c5fd463 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:10:04.918520 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-67cdbc58-7b10-4107-aaf8-d12c1c5fd463 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:10:04.919007 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-67cdbc58-7b10-4107-aaf8-d12c1c5fd463 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:10:04.919452 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-67cdbc58-7b10-4107-aaf8-d12c1c5fd463 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:10:04.920172 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-67cdbc58-7b10-4107-aaf8-d12c1c5fd463 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:10:04.920632 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-67cdbc58-7b10-4107-aaf8-d12c1c5fd463 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:10:04.921062 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-67cdbc58-7b10-4107-aaf8-d12c1c5fd463 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:10:05.138789 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-67cdbc58-7b10-4107-aaf8-d12c1c5fd463 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:10:05.147167 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-67cdbc58-7b10-4107-aaf8-d12c1c5fd463 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b" status: 200 len: 1366 microversion: 2.1 time: 0.240299 Sep 16 02:10:05.147825 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 532/1051] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:10:04 2022] GET /compute/v2.1/servers/b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b => generated 1366 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:10:05.272287 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [req-a11f2c8e-a7c3-4cf0-a433-a7442640e257 req-dafcd15c-76d0-4c78-b4bd-70f0072e3562 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b", "tag": "f33275e6-6522-40eb-a550-7dce0558702f"}]} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:10:05.282493 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-a11f2c8e-a7c3-4cf0-a433-a7442640e257 req-dafcd15c-76d0-4c78-b4bd-70f0072e3562 service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:10:05.283054 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-a11f2c8e-a7c3-4cf0-a433-a7442640e257 req-dafcd15c-76d0-4c78-b4bd-70f0072e3562 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:10:05.283615 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-a11f2c8e-a7c3-4cf0-a433-a7442640e257 req-dafcd15c-76d0-4c78-b4bd-70f0072e3562 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:10:05.294971 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.compute.server_external_events [req-a11f2c8e-a7c3-4cf0-a433-a7442640e257 req-dafcd15c-76d0-4c78-b4bd-70f0072e3562 service nova] Creating event network-changed:f33275e6-6522-40eb-a550-7dce0558702f for instance b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b on hv-cinder-84914 Sep 16 02:10:05.300656 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [req-a11f2c8e-a7c3-4cf0-a433-a7442640e257 req-dafcd15c-76d0-4c78-b4bd-70f0072e3562 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032290 Sep 16 02:10:05.301335 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 520/1052] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:10:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:10:06.170590 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-f348148a-e616-45a7-b261-7aabe41873dc tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:10:06.171197 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-f348148a-e616-45a7-b261-7aabe41873dc tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:10:06.177863 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f348148a-e616-45a7-b261-7aabe41873dc tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:10:06.178346 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f348148a-e616-45a7-b261-7aabe41873dc tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:10:06.178810 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f348148a-e616-45a7-b261-7aabe41873dc tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:10:06.179516 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f348148a-e616-45a7-b261-7aabe41873dc tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:10:06.179987 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f348148a-e616-45a7-b261-7aabe41873dc tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:10:06.180418 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f348148a-e616-45a7-b261-7aabe41873dc tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:10:06.307449 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-f348148a-e616-45a7-b261-7aabe41873dc tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:10:06.315677 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-f348148a-e616-45a7-b261-7aabe41873dc tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b" status: 200 len: 1366 microversion: 2.1 time: 0.148952 Sep 16 02:10:06.316377 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 533/1053] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:10:06 2022] GET /compute/v2.1/servers/b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:10:07.339551 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-dd9ff9b1-e647-4737-b268-c2436cdff682 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:10:07.340281 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-dd9ff9b1-e647-4737-b268-c2436cdff682 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:10:07.346711 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-dd9ff9b1-e647-4737-b268-c2436cdff682 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:10:07.347206 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-dd9ff9b1-e647-4737-b268-c2436cdff682 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:10:07.347643 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-dd9ff9b1-e647-4737-b268-c2436cdff682 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:10:07.348367 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-dd9ff9b1-e647-4737-b268-c2436cdff682 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:10:07.348825 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-dd9ff9b1-e647-4737-b268-c2436cdff682 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:10:07.349249 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-dd9ff9b1-e647-4737-b268-c2436cdff682 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:10:07.476935 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-dd9ff9b1-e647-4737-b268-c2436cdff682 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:10:07.484433 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-dd9ff9b1-e647-4737-b268-c2436cdff682 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b" status: 200 len: 1366 microversion: 2.1 time: 0.149645 Sep 16 02:10:07.485032 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 521/1054] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:10:07 2022] GET /compute/v2.1/servers/b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:10:08.507393 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-4922f328-2dde-4bc4-b2b6-f846a99c7082 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:10:08.508034 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-4922f328-2dde-4bc4-b2b6-f846a99c7082 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:10:08.514443 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4922f328-2dde-4bc4-b2b6-f846a99c7082 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:10:08.514934 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4922f328-2dde-4bc4-b2b6-f846a99c7082 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:10:08.515373 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4922f328-2dde-4bc4-b2b6-f846a99c7082 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:10:08.516228 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4922f328-2dde-4bc4-b2b6-f846a99c7082 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:10:08.516700 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4922f328-2dde-4bc4-b2b6-f846a99c7082 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:10:08.517129 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-4922f328-2dde-4bc4-b2b6-f846a99c7082 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:10:08.644388 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-4922f328-2dde-4bc4-b2b6-f846a99c7082 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:10:08.652109 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-4922f328-2dde-4bc4-b2b6-f846a99c7082 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b" status: 200 len: 1366 microversion: 2.1 time: 0.148601 Sep 16 02:10:08.652668 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 534/1055] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:10:08 2022] GET /compute/v2.1/servers/b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:10:09.355001 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [req-06122520-1bf2-4a4e-b38f-41f4a80349cd req-110df941-1f0f-4b64-a05b-cf3e7c8f6153 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b", "name": "network-vif-plugged", "status": "completed", "tag": "f33275e6-6522-40eb-a550-7dce0558702f"}]} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:10:09.366727 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-06122520-1bf2-4a4e-b38f-41f4a80349cd req-110df941-1f0f-4b64-a05b-cf3e7c8f6153 service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:10:09.367208 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-06122520-1bf2-4a4e-b38f-41f4a80349cd req-110df941-1f0f-4b64-a05b-cf3e7c8f6153 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:10:09.367637 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-06122520-1bf2-4a4e-b38f-41f4a80349cd req-110df941-1f0f-4b64-a05b-cf3e7c8f6153 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:10:09.379722 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.compute.server_external_events [req-06122520-1bf2-4a4e-b38f-41f4a80349cd req-110df941-1f0f-4b64-a05b-cf3e7c8f6153 service nova] Creating event network-vif-plugged:f33275e6-6522-40eb-a550-7dce0558702f for instance b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b on hv-cinder-84914 Sep 16 02:10:09.384618 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [req-06122520-1bf2-4a4e-b38f-41f4a80349cd req-110df941-1f0f-4b64-a05b-cf3e7c8f6153 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.096243 Sep 16 02:10:09.385239 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 522/1056] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:10:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:10:09.676037 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-1e2bb7aa-8e42-40e9-87ee-c6ec11f12057 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:10:09.676656 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-1e2bb7aa-8e42-40e9-87ee-c6ec11f12057 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:10:09.683755 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1e2bb7aa-8e42-40e9-87ee-c6ec11f12057 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:10:09.684348 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1e2bb7aa-8e42-40e9-87ee-c6ec11f12057 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:10:09.685011 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1e2bb7aa-8e42-40e9-87ee-c6ec11f12057 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:10:09.685808 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1e2bb7aa-8e42-40e9-87ee-c6ec11f12057 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:10:09.686441 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1e2bb7aa-8e42-40e9-87ee-c6ec11f12057 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:10:09.686869 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1e2bb7aa-8e42-40e9-87ee-c6ec11f12057 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:10:10.141194 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-1e2bb7aa-8e42-40e9-87ee-c6ec11f12057 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:10:10.148681 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-1e2bb7aa-8e42-40e9-87ee-c6ec11f12057 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b" status: 200 len: 1366 microversion: 2.1 time: 0.476981 Sep 16 02:10:10.149242 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 535/1057] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:10:09 2022] GET /compute/v2.1/servers/b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b => generated 1366 bytes in 478 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 02:10:11.173182 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-a6e907da-b265-4192-90a3-11354e49e2d2 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:10:11.173889 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-a6e907da-b265-4192-90a3-11354e49e2d2 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:10:11.180629 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a6e907da-b265-4192-90a3-11354e49e2d2 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:10:11.181107 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a6e907da-b265-4192-90a3-11354e49e2d2 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:10:11.181544 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a6e907da-b265-4192-90a3-11354e49e2d2 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:10:11.182229 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a6e907da-b265-4192-90a3-11354e49e2d2 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:10:11.182686 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a6e907da-b265-4192-90a3-11354e49e2d2 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:10:11.183109 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a6e907da-b265-4192-90a3-11354e49e2d2 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:10:11.315829 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-a6e907da-b265-4192-90a3-11354e49e2d2 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:10:11.323410 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-a6e907da-b265-4192-90a3-11354e49e2d2 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b" status: 200 len: 1366 microversion: 2.1 time: 0.154687 Sep 16 02:10:11.323988 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 523/1058] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:10:11 2022] GET /compute/v2.1/servers/b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:10:12.346544 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-b41df346-0b53-4cda-a319-82f25caf1aaa tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:10:12.347061 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-b41df346-0b53-4cda-a319-82f25caf1aaa tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:10:12.353422 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b41df346-0b53-4cda-a319-82f25caf1aaa tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:10:12.353906 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b41df346-0b53-4cda-a319-82f25caf1aaa tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:10:12.354341 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b41df346-0b53-4cda-a319-82f25caf1aaa tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:10:12.355020 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b41df346-0b53-4cda-a319-82f25caf1aaa tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:10:12.355479 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b41df346-0b53-4cda-a319-82f25caf1aaa tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:10:12.355900 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b41df346-0b53-4cda-a319-82f25caf1aaa tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:10:12.488321 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-b41df346-0b53-4cda-a319-82f25caf1aaa tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:10:12.495771 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-b41df346-0b53-4cda-a319-82f25caf1aaa tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b" status: 200 len: 1555 microversion: 2.1 time: 0.153419 Sep 16 02:10:12.496360 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 536/1059] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:10:12 2022] GET /compute/v2.1/servers/b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:10:12.519129 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-cc127860-8056-465d-aefb-dfe2e524589f tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:10:12.519644 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-cc127860-8056-465d-aefb-dfe2e524589f tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:10:12.525955 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cc127860-8056-465d-aefb-dfe2e524589f tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:10:12.526431 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cc127860-8056-465d-aefb-dfe2e524589f tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:10:12.526858 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cc127860-8056-465d-aefb-dfe2e524589f tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:10:12.527534 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cc127860-8056-465d-aefb-dfe2e524589f tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:10:12.528007 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cc127860-8056-465d-aefb-dfe2e524589f tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:10:12.528433 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cc127860-8056-465d-aefb-dfe2e524589f tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:10:12.605707 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-cc127860-8056-465d-aefb-dfe2e524589f tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.090684 Sep 16 02:10:12.606326 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 524/1060] 10.222.0.42 () {58 vars in 1275 bytes} [Fri Sep 16 02:10:12 2022] GET /compute/v2.1/servers/b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b/os-interface => generated 284 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:10:13.730879 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [req-86c7bbf2-0155-4b5e-9a41-8bc31bfcc39c req-0b82de21-c805-4ce6-b30d-384aef0e70ea service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b", "tag": "f33275e6-6522-40eb-a550-7dce0558702f"}]} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:10:13.736533 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell0:SELECT=6 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:10:13.743148 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-86c7bbf2-0155-4b5e-9a41-8bc31bfcc39c req-0b82de21-c805-4ce6-b30d-384aef0e70ea service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:10:13.743782 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-86c7bbf2-0155-4b5e-9a41-8bc31bfcc39c req-0b82de21-c805-4ce6-b30d-384aef0e70ea service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:10:13.744252 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-86c7bbf2-0155-4b5e-9a41-8bc31bfcc39c req-0b82de21-c805-4ce6-b30d-384aef0e70ea service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:10:13.756282 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.compute.server_external_events [req-86c7bbf2-0155-4b5e-9a41-8bc31bfcc39c req-0b82de21-c805-4ce6-b30d-384aef0e70ea service nova] Creating event network-changed:f33275e6-6522-40eb-a550-7dce0558702f for instance b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b on hv-cinder-84914 Sep 16 02:10:13.761308 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [req-86c7bbf2-0155-4b5e-9a41-8bc31bfcc39c req-0b82de21-c805-4ce6-b30d-384aef0e70ea service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034207 Sep 16 02:10:13.761900 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 537/1061] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:10:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:11:00.305439 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell0:SELECT=2 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:11:00.306222 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell0:SELECT=6 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:11:00.307538 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_api:SELECT=44,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:11:00.308187 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell1:SELECT=74,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:11:00.312430 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-d8122344-91fa-4c18-9dc1-709a418897c2 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:11:00.312929 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-d8122344-91fa-4c18-9dc1-709a418897c2 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: c2851de3-9ab0-467a-8026-5b44a95c5493] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:11:00.322686 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d8122344-91fa-4c18-9dc1-709a418897c2 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:00.323173 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d8122344-91fa-4c18-9dc1-709a418897c2 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:00.323611 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d8122344-91fa-4c18-9dc1-709a418897c2 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:00.324329 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d8122344-91fa-4c18-9dc1-709a418897c2 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:00.324786 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d8122344-91fa-4c18-9dc1-709a418897c2 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:00.325218 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d8122344-91fa-4c18-9dc1-709a418897c2 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:00.351621 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-d8122344-91fa-4c18-9dc1-709a418897c2 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: c2851de3-9ab0-467a-8026-5b44a95c5493] Going to try to terminate instance {{(pid=120440) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 02:11:00.425552 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-d8122344-91fa-4c18-9dc1-709a418897c2 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c2851de3-9ab0-467a-8026-5b44a95c5493" status: 204 len: 0 microversion: 2.1 time: 0.120636 Sep 16 02:11:00.426055 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 525/1062] 10.222.0.42 () {58 vars in 1239 bytes} [Fri Sep 16 02:11:00 2022] DELETE /compute/v2.1/servers/c2851de3-9ab0-467a-8026-5b44a95c5493 => generated 0 bytes in 122 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 02:11:00.432816 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_api:SELECT=46,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:11:00.433613 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell1:SELECT=72,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:11:00.438549 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-03924900-7a21-4f4f-8b45-cf5eac9c8dc5 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:11:00.439275 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-03924900-7a21-4f4f-8b45-cf5eac9c8dc5 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: c2851de3-9ab0-467a-8026-5b44a95c5493] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:11:00.446896 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-03924900-7a21-4f4f-8b45-cf5eac9c8dc5 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:00.447428 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-03924900-7a21-4f4f-8b45-cf5eac9c8dc5 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:00.447865 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-03924900-7a21-4f4f-8b45-cf5eac9c8dc5 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:00.448571 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-03924900-7a21-4f4f-8b45-cf5eac9c8dc5 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:00.449025 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-03924900-7a21-4f4f-8b45-cf5eac9c8dc5 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:00.449451 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-03924900-7a21-4f4f-8b45-cf5eac9c8dc5 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:00.584372 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-03924900-7a21-4f4f-8b45-cf5eac9c8dc5 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:11:00.591892 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-03924900-7a21-4f4f-8b45-cf5eac9c8dc5 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/c2851de3-9ab0-467a-8026-5b44a95c5493" status: 200 len: 1577 microversion: 2.1 time: 0.160881 Sep 16 02:11:00.592480 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 538/1063] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:11:00 2022] GET /compute/v2.1/servers/c2851de3-9ab0-467a-8026-5b44a95c5493 => generated 1577 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:11:01.614741 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-3433b002-6ef0-4ef1-8792-53ba62815d47 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:11:01.615438 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-3433b002-6ef0-4ef1-8792-53ba62815d47 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: c2851de3-9ab0-467a-8026-5b44a95c5493] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:11:01.622291 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3433b002-6ef0-4ef1-8792-53ba62815d47 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:01.622780 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3433b002-6ef0-4ef1-8792-53ba62815d47 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:01.623239 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3433b002-6ef0-4ef1-8792-53ba62815d47 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:01.623927 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3433b002-6ef0-4ef1-8792-53ba62815d47 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:01.624464 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3433b002-6ef0-4ef1-8792-53ba62815d47 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:01.624885 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3433b002-6ef0-4ef1-8792-53ba62815d47 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:01.757116 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-3433b002-6ef0-4ef1-8792-53ba62815d47 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:11:01.765392 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-3433b002-6ef0-4ef1-8792-53ba62815d47 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/c2851de3-9ab0-467a-8026-5b44a95c5493" status: 200 len: 1577 microversion: 2.1 time: 0.154298 Sep 16 02:11:01.765929 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 526/1064] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:11:01 2022] GET /compute/v2.1/servers/c2851de3-9ab0-467a-8026-5b44a95c5493 => generated 1577 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:11:02.787617 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-fbe44eda-1006-41c1-8c8c-005b17b4a76e tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:11:02.788260 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-fbe44eda-1006-41c1-8c8c-005b17b4a76e tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: c2851de3-9ab0-467a-8026-5b44a95c5493] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:11:02.794801 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fbe44eda-1006-41c1-8c8c-005b17b4a76e tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:02.795297 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fbe44eda-1006-41c1-8c8c-005b17b4a76e tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:02.795759 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fbe44eda-1006-41c1-8c8c-005b17b4a76e tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:02.801349 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fbe44eda-1006-41c1-8c8c-005b17b4a76e tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:02.801837 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fbe44eda-1006-41c1-8c8c-005b17b4a76e tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:02.802277 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fbe44eda-1006-41c1-8c8c-005b17b4a76e tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:03.029013 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-fbe44eda-1006-41c1-8c8c-005b17b4a76e tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:11:03.037603 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-fbe44eda-1006-41c1-8c8c-005b17b4a76e tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/c2851de3-9ab0-467a-8026-5b44a95c5493" status: 200 len: 1577 microversion: 2.1 time: 0.253825 Sep 16 02:11:03.038173 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 539/1065] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:11:02 2022] GET /compute/v2.1/servers/c2851de3-9ab0-467a-8026-5b44a95c5493 => generated 1577 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:11:03.245487 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [req-1db5e4ae-a36b-4248-9bb6-bbf76ba9e7fb req-2162e7eb-ec72-4fce-967e-7fe8a13692a2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c2851de3-9ab0-467a-8026-5b44a95c5493", "name": "network-vif-deleted", "tag": "3cb201ab-30c6-40a6-9607-59b641eed269"}]} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:11:03.259843 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-1db5e4ae-a36b-4248-9bb6-bbf76ba9e7fb req-2162e7eb-ec72-4fce-967e-7fe8a13692a2 service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:03.260612 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-1db5e4ae-a36b-4248-9bb6-bbf76ba9e7fb req-2162e7eb-ec72-4fce-967e-7fe8a13692a2 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:03.261037 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-1db5e4ae-a36b-4248-9bb6-bbf76ba9e7fb req-2162e7eb-ec72-4fce-967e-7fe8a13692a2 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:03.284624 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.compute.server_external_events [req-1db5e4ae-a36b-4248-9bb6-bbf76ba9e7fb req-2162e7eb-ec72-4fce-967e-7fe8a13692a2 service nova] Creating event network-vif-deleted:3cb201ab-30c6-40a6-9607-59b641eed269 for instance c2851de3-9ab0-467a-8026-5b44a95c5493 on hv-cinder-84914 Sep 16 02:11:03.289850 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [req-1db5e4ae-a36b-4248-9bb6-bbf76ba9e7fb req-2162e7eb-ec72-4fce-967e-7fe8a13692a2 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048278 Sep 16 02:11:03.290694 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 527/1066] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:11:04.060858 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-8c8917ff-e439-436c-aa2f-1e4e672addb2 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:11:04.061396 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-8c8917ff-e439-436c-aa2f-1e4e672addb2 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: c2851de3-9ab0-467a-8026-5b44a95c5493] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:11:04.068769 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8c8917ff-e439-436c-aa2f-1e4e672addb2 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:04.069257 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8c8917ff-e439-436c-aa2f-1e4e672addb2 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:04.069695 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8c8917ff-e439-436c-aa2f-1e4e672addb2 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:04.070394 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8c8917ff-e439-436c-aa2f-1e4e672addb2 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:04.070847 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8c8917ff-e439-436c-aa2f-1e4e672addb2 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:04.071273 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8c8917ff-e439-436c-aa2f-1e4e672addb2 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:04.104760 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8c8917ff-e439-436c-aa2f-1e4e672addb2 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:04.105109 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8c8917ff-e439-436c-aa2f-1e4e672addb2 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:04.105622 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8c8917ff-e439-436c-aa2f-1e4e672addb2 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:04.106076 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.objects.instance [None req-8c8917ff-e439-436c-aa2f-1e4e672addb2 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lazy-loading 'fault' on Instance uuid c2851de3-9ab0-467a-8026-5b44a95c5493 {{(pid=120441) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 02:11:04.153745 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-8c8917ff-e439-436c-aa2f-1e4e672addb2 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:11:04.163825 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-8c8917ff-e439-436c-aa2f-1e4e672addb2 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/c2851de3-9ab0-467a-8026-5b44a95c5493" status: 200 len: 1231 microversion: 2.1 time: 0.106831 Sep 16 02:11:04.164703 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 540/1067] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:11:04 2022] GET /compute/v2.1/servers/c2851de3-9ab0-467a-8026-5b44a95c5493 => generated 1231 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:11:05.188733 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-47c2138e-e886-46d5-b857-649456a8a5d2 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:11:05.189463 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-47c2138e-e886-46d5-b857-649456a8a5d2 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: c2851de3-9ab0-467a-8026-5b44a95c5493] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:11:05.195504 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-47c2138e-e886-46d5-b857-649456a8a5d2 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:05.196007 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-47c2138e-e886-46d5-b857-649456a8a5d2 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:05.196444 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-47c2138e-e886-46d5-b857-649456a8a5d2 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:05.197121 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-47c2138e-e886-46d5-b857-649456a8a5d2 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:05.197574 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-47c2138e-e886-46d5-b857-649456a8a5d2 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:05.197991 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-47c2138e-e886-46d5-b857-649456a8a5d2 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:05.211799 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.wsgi [None req-47c2138e-e886-46d5-b857-649456a8a5d2 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] HTTP exception thrown: Instance c2851de3-9ab0-467a-8026-5b44a95c5493 could not be found. Sep 16 02:11:05.213400 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-47c2138e-e886-46d5-b857-649456a8a5d2 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Request method failure captured: Sep 16 02:11:05.213400 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: request: GET /compute/v2.1/servers/c2851de3-9ab0-467a-8026-5b44a95c5493 HTTP/1.1 Sep 16 02:11:05.213400 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept: application/json Sep 16 02:11:05.213400 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept-Encoding: identity Sep 16 02:11:05.213400 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Connection: close Sep 16 02:11:05.213400 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Length: 0 Sep 16 02:11:05.213400 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Type: application/json Sep 16 02:11:05.213400 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Host: 10.222.0.42 Sep 16 02:11:05.213400 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Openstack-System-Scope: None Sep 16 02:11:05.213400 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: User-Agent: python-urllib3/1.26.12 Sep 16 02:11:05.213400 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Auth-Token: gAAAAABjI9p8TdjH_kwBdldDF3CEs8I-vUyEHyLFI9oJxz2KE9pQ1dnvHn6dUCFQWAJkaiyVsVT2er0HnGWs49wNmoEdAyHHD4Cyp-FSTYX5lE5pMNkeMgCJjSiOjywjN66polzI7ozDE0K2Ot_nthdrnO4uhqOrWK34j169f1muJ7tt4Zo1oh8 Sep 16 02:11:05.213400 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Id: None Sep 16 02:11:05.213400 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Name: None Sep 16 02:11:05.213400 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Identity-Status: Confirmed Sep 16 02:11:05.213400 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Is-Admin-Project: True Sep 16 02:11:05.213400 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Id: default Sep 16 02:11:05.213400 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Name: Default Sep 16 02:11:05.213400 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Id: 9cfcd2376b1c4398befa49b423aaae26 Sep 16 02:11:05.213400 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Name: tempest-TestVolumeBootPattern-1895408842 Sep 16 02:11:05.213400 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Role: member,reader Sep 16 02:11:05.213400 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Roles: member,reader Sep 16 02:11:05.215059 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9cfcd2376b1c4398befa49b423aaae26"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9cfcd2376b1c4398befa49b423aaae26"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9cfcd2376b1c4398befa49b423aaae26"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9cfcd2376b1c4398befa49b423aaae26"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 02:11:05.215059 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant: tempest-TestVolumeBootPattern-1895408842 Sep 16 02:11:05.215059 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Id: 9cfcd2376b1c4398befa49b423aaae26 Sep 16 02:11:05.215059 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Name: tempest-TestVolumeBootPattern-1895408842 Sep 16 02:11:05.215059 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User: tempest-TestVolumeBootPattern-1895408842-project Sep 16 02:11:05.215059 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Id: default Sep 16 02:11:05.215059 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Name: Default Sep 16 02:11:05.215059 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Id: 772659a1932d45dea2c5120c4497314b Sep 16 02:11:05.215059 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Name: tempest-TestVolumeBootPattern-1895408842-project Sep 16 02:11:05.215059 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: method: > Sep 16 02:11:05.215059 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: exception: Instance c2851de3-9ab0-467a-8026-5b44a95c5493 could not be found. Sep 16 02:11:05.215059 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: action_args: {'id': 'c2851de3-9ab0-467a-8026-5b44a95c5493'} Sep 16 02:11:05.216044 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 02:11:05.216044 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:11:05.216044 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 02:11:05.216044 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 02:11:05.216044 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 02:11:05.216044 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 02:11:05.216044 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 02:11:05.216044 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 02:11:05.216044 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 02:11:05.216044 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 02:11:05.216044 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2851de3-9ab0-467a-8026-5b44a95c5493 could not be found. Sep 16 02:11:05.216044 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:11:05.216044 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:11:05.216044 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:11:05.216044 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:11:05.216044 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:11:05.216044 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:11:05.216044 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 02:11:05.216044 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 02:11:05.216044 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 02:11:05.217596 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 02:11:05.217596 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 02:11:05.217596 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 02:11:05.217596 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 02:11:05.217596 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 02:11:05.217596 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 02:11:05.217596 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 02:11:05.217596 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2851de3-9ab0-467a-8026-5b44a95c5493 could not be found. Sep 16 02:11:05.217596 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:11:05.217596 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:11:05.217596 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:11:05.217596 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:11:05.217596 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:11:05.217596 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:11:05.217596 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 02:11:05.217596 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 02:11:05.217596 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2851de3-9ab0-467a-8026-5b44a95c5493 could not be found. Sep 16 02:11:05.217596 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:11:05.219179 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-47c2138e-e886-46d5-b857-649456a8a5d2 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Returning 404 to user: Instance c2851de3-9ab0-467a-8026-5b44a95c5493 could not be found. {{(pid=120440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 02:11:05.219179 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-47c2138e-e886-46d5-b857-649456a8a5d2 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/c2851de3-9ab0-467a-8026-5b44a95c5493" status: 404 len: 111 microversion: 2.1 time: 0.031486 Sep 16 02:11:05.219179 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 528/1068] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:11:05 2022] GET /compute/v2.1/servers/c2851de3-9ab0-467a-8026-5b44a95c5493 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 02:11:05.264976 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-e7ebecb2-ad6e-4331-ada2-af18e4cc9efe tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-322211443", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1042516554", "security_groups": [{"name": "tempest-secgroup-smoke-201932569"}], "block_device_mapping_v2": [{"uuid": "ed0b2ae5-5091-4593-a823-7d08008cea99", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "26a960ea-9980-48fb-8180-c5983fb286de"}]}} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:11:05.377410 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.network.neutron [None req-e7ebecb2-ad6e-4331-ada2-af18e4cc9efe tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] validate_networks() for [('26a960ea-9980-48fb-8180-c5983fb286de', None, None, None, None, None)] {{(pid=120441) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 02:11:05.742029 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.virt.hardware [None req-e7ebecb2-ad6e-4331-ada2-af18e4cc9efe tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Flavor limits 0:0:0 {{(pid=120441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 02:11:05.742453 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.virt.hardware [None req-e7ebecb2-ad6e-4331-ada2-af18e4cc9efe tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Image limits 0:0:0 {{(pid=120441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 02:11:05.742958 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.virt.hardware [None req-e7ebecb2-ad6e-4331-ada2-af18e4cc9efe tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Flavor pref 0:0:0 {{(pid=120441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 02:11:05.743369 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.virt.hardware [None req-e7ebecb2-ad6e-4331-ada2-af18e4cc9efe tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Image pref 0:0:0 {{(pid=120441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 02:11:05.743780 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.virt.hardware [None req-e7ebecb2-ad6e-4331-ada2-af18e4cc9efe tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 02:11:05.752884 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e7ebecb2-ad6e-4331-ada2-af18e4cc9efe tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:05.753370 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e7ebecb2-ad6e-4331-ada2-af18e4cc9efe tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:05.753806 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e7ebecb2-ad6e-4331-ada2-af18e4cc9efe tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:05.754527 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e7ebecb2-ad6e-4331-ada2-af18e4cc9efe tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:05.754979 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e7ebecb2-ad6e-4331-ada2-af18e4cc9efe tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:05.755402 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e7ebecb2-ad6e-4331-ada2-af18e4cc9efe tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:05.771646 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.quota [None req-e7ebecb2-ad6e-4331-ada2-af18e4cc9efe tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Getting quotas for project 9cfcd2376b1c4398befa49b423aaae26. Resources: {'cores', 'ram', 'instances'} {{(pid=120441) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 02:11:05.775550 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.quota [None req-e7ebecb2-ad6e-4331-ada2-af18e4cc9efe tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Getting quotas for user 772659a1932d45dea2c5120c4497314b and project 9cfcd2376b1c4398befa49b423aaae26. Resources: {'cores', 'ram', 'instances'} {{(pid=120441) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 02:11:05.832520 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-e7ebecb2-ad6e-4331-ada2-af18e4cc9efe tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Going to run 1 instances... {{(pid=120441) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 02:11:05.834666 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-e7ebecb2-ad6e-4331-ada2-af18e4cc9efe tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: db657714-7c42-4b17-9954-8ad0a4e2ccba] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ed0b2ae5-5091-4593-a823-7d08008cea99',volume_size=None,volume_type=None)] {{(pid=120441) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 02:11:05.963374 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-e7ebecb2-ad6e-4331-ada2-af18e4cc9efe tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.702317 Sep 16 02:11:05.964034 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 541/1069] 10.222.0.42 () {60 vars in 1147 bytes} [Fri Sep 16 02:11:05 2022] POST /compute/v2.1/servers => generated 405 bytes in 704 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 02:11:05.975434 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-aadd74d1-c64f-4682-a94a-24f2e83c1907 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:11:05.976076 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-aadd74d1-c64f-4682-a94a-24f2e83c1907 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: db657714-7c42-4b17-9954-8ad0a4e2ccba] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:11:06.033709 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-aadd74d1-c64f-4682-a94a-24f2e83c1907 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:11:06.040683 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-aadd74d1-c64f-4682-a94a-24f2e83c1907 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/db657714-7c42-4b17-9954-8ad0a4e2ccba" status: 200 len: 1094 microversion: 2.1 time: 0.069008 Sep 16 02:11:06.041239 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 529/1070] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:11:05 2022] GET /compute/v2.1/servers/db657714-7c42-4b17-9954-8ad0a4e2ccba => generated 1094 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:11:07.064899 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-39859b7d-4d0f-4871-9f8e-3650db970427 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:11:07.065462 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-39859b7d-4d0f-4871-9f8e-3650db970427 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: db657714-7c42-4b17-9954-8ad0a4e2ccba] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:11:07.073213 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-39859b7d-4d0f-4871-9f8e-3650db970427 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:07.073696 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-39859b7d-4d0f-4871-9f8e-3650db970427 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:07.074130 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-39859b7d-4d0f-4871-9f8e-3650db970427 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:07.074835 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-39859b7d-4d0f-4871-9f8e-3650db970427 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:07.075270 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-39859b7d-4d0f-4871-9f8e-3650db970427 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:07.075684 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-39859b7d-4d0f-4871-9f8e-3650db970427 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:07.166167 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-39859b7d-4d0f-4871-9f8e-3650db970427 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:11:07.176280 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-39859b7d-4d0f-4871-9f8e-3650db970427 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/db657714-7c42-4b17-9954-8ad0a4e2ccba" status: 200 len: 1200 microversion: 2.1 time: 0.117013 Sep 16 02:11:07.177028 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 542/1071] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:11:07 2022] GET /compute/v2.1/servers/db657714-7c42-4b17-9954-8ad0a4e2ccba => generated 1200 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:11:08.200645 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-821c2aff-1831-4967-96a7-7d181e1d9b23 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:11:08.201201 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-821c2aff-1831-4967-96a7-7d181e1d9b23 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: db657714-7c42-4b17-9954-8ad0a4e2ccba] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:11:08.209034 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-821c2aff-1831-4967-96a7-7d181e1d9b23 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:08.209519 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-821c2aff-1831-4967-96a7-7d181e1d9b23 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:08.209946 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-821c2aff-1831-4967-96a7-7d181e1d9b23 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:08.210617 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-821c2aff-1831-4967-96a7-7d181e1d9b23 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:08.211083 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-821c2aff-1831-4967-96a7-7d181e1d9b23 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:08.211503 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-821c2aff-1831-4967-96a7-7d181e1d9b23 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:08.353006 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-821c2aff-1831-4967-96a7-7d181e1d9b23 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:11:08.360946 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-821c2aff-1831-4967-96a7-7d181e1d9b23 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/db657714-7c42-4b17-9954-8ad0a4e2ccba" status: 200 len: 1265 microversion: 2.1 time: 0.164212 Sep 16 02:11:08.361612 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 530/1072] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:11:08 2022] GET /compute/v2.1/servers/db657714-7c42-4b17-9954-8ad0a4e2ccba => generated 1265 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:11:08.536741 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [req-abe4a5ab-731c-4e5e-b0d4-0008e171e88a req-d7a44337-d4b9-4506-aa79-b6f0f093b1f9 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db657714-7c42-4b17-9954-8ad0a4e2ccba", "tag": "8cfd42e0-f275-4fb7-b9b7-11b1d2222158"}]} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:11:08.549812 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-abe4a5ab-731c-4e5e-b0d4-0008e171e88a req-d7a44337-d4b9-4506-aa79-b6f0f093b1f9 service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:08.550300 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-abe4a5ab-731c-4e5e-b0d4-0008e171e88a req-d7a44337-d4b9-4506-aa79-b6f0f093b1f9 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:08.550734 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-abe4a5ab-731c-4e5e-b0d4-0008e171e88a req-d7a44337-d4b9-4506-aa79-b6f0f093b1f9 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:08.562213 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.compute.server_external_events [req-abe4a5ab-731c-4e5e-b0d4-0008e171e88a req-d7a44337-d4b9-4506-aa79-b6f0f093b1f9 service nova] Creating event network-changed:8cfd42e0-f275-4fb7-b9b7-11b1d2222158 for instance db657714-7c42-4b17-9954-8ad0a4e2ccba on hv-cinder-84914 Sep 16 02:11:08.567644 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [req-abe4a5ab-731c-4e5e-b0d4-0008e171e88a req-d7a44337-d4b9-4506-aa79-b6f0f093b1f9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034716 Sep 16 02:11:08.568267 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 543/1073] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:11:08 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:11:09.383919 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-d434b187-ff50-42d9-ab54-50d25dffaf66 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:11:09.384541 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-d434b187-ff50-42d9-ab54-50d25dffaf66 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: db657714-7c42-4b17-9954-8ad0a4e2ccba] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:11:09.390969 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d434b187-ff50-42d9-ab54-50d25dffaf66 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:09.391453 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d434b187-ff50-42d9-ab54-50d25dffaf66 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:09.391895 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d434b187-ff50-42d9-ab54-50d25dffaf66 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:09.392613 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d434b187-ff50-42d9-ab54-50d25dffaf66 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:09.393070 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d434b187-ff50-42d9-ab54-50d25dffaf66 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:09.393503 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d434b187-ff50-42d9-ab54-50d25dffaf66 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:09.522416 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-d434b187-ff50-42d9-ab54-50d25dffaf66 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:11:09.530587 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-d434b187-ff50-42d9-ab54-50d25dffaf66 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/db657714-7c42-4b17-9954-8ad0a4e2ccba" status: 200 len: 1265 microversion: 2.1 time: 0.150113 Sep 16 02:11:09.531148 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 531/1074] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:11:09 2022] GET /compute/v2.1/servers/db657714-7c42-4b17-9954-8ad0a4e2ccba => generated 1265 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:11:10.553299 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-821eb6a1-4f8d-4484-94d2-a89609953a1e tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:11:10.554017 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-821eb6a1-4f8d-4484-94d2-a89609953a1e tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: db657714-7c42-4b17-9954-8ad0a4e2ccba] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:11:10.560518 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-821eb6a1-4f8d-4484-94d2-a89609953a1e tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:10.561269 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-821eb6a1-4f8d-4484-94d2-a89609953a1e tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:10.561703 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-821eb6a1-4f8d-4484-94d2-a89609953a1e tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:10.564048 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-821eb6a1-4f8d-4484-94d2-a89609953a1e tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:10.564682 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-821eb6a1-4f8d-4484-94d2-a89609953a1e tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:10.565347 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-821eb6a1-4f8d-4484-94d2-a89609953a1e tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:10.916341 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-821eb6a1-4f8d-4484-94d2-a89609953a1e tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:11:10.924025 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-821eb6a1-4f8d-4484-94d2-a89609953a1e tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/db657714-7c42-4b17-9954-8ad0a4e2ccba" status: 200 len: 1265 microversion: 2.1 time: 0.375445 Sep 16 02:11:10.924591 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 544/1075] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:11:10 2022] GET /compute/v2.1/servers/db657714-7c42-4b17-9954-8ad0a4e2ccba => generated 1265 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:11:11.946957 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-bdbc1e69-09c7-4eda-bdf5-6aa5f1caff42 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:11:11.947591 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-bdbc1e69-09c7-4eda-bdf5-6aa5f1caff42 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: db657714-7c42-4b17-9954-8ad0a4e2ccba] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:11:11.954507 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bdbc1e69-09c7-4eda-bdf5-6aa5f1caff42 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:11.955022 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bdbc1e69-09c7-4eda-bdf5-6aa5f1caff42 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:11.955487 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bdbc1e69-09c7-4eda-bdf5-6aa5f1caff42 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:11.956286 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bdbc1e69-09c7-4eda-bdf5-6aa5f1caff42 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:11.956744 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bdbc1e69-09c7-4eda-bdf5-6aa5f1caff42 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:11.957169 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bdbc1e69-09c7-4eda-bdf5-6aa5f1caff42 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:12.086898 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-bdbc1e69-09c7-4eda-bdf5-6aa5f1caff42 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:11:12.095201 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-bdbc1e69-09c7-4eda-bdf5-6aa5f1caff42 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/db657714-7c42-4b17-9954-8ad0a4e2ccba" status: 200 len: 1265 microversion: 2.1 time: 0.152203 Sep 16 02:11:12.095759 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 532/1076] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:11:11 2022] GET /compute/v2.1/servers/db657714-7c42-4b17-9954-8ad0a4e2ccba => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:11:13.117268 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-a4af4e45-b3c0-4f8e-8908-9ea976e0cdad tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:11:13.117873 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-a4af4e45-b3c0-4f8e-8908-9ea976e0cdad tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: db657714-7c42-4b17-9954-8ad0a4e2ccba] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:11:13.125136 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a4af4e45-b3c0-4f8e-8908-9ea976e0cdad tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:13.125612 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a4af4e45-b3c0-4f8e-8908-9ea976e0cdad tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:13.126077 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a4af4e45-b3c0-4f8e-8908-9ea976e0cdad tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:13.126743 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a4af4e45-b3c0-4f8e-8908-9ea976e0cdad tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:13.127190 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a4af4e45-b3c0-4f8e-8908-9ea976e0cdad tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:13.127606 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a4af4e45-b3c0-4f8e-8908-9ea976e0cdad tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:13.258982 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-a4af4e45-b3c0-4f8e-8908-9ea976e0cdad tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:11:13.266735 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-a4af4e45-b3c0-4f8e-8908-9ea976e0cdad tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/db657714-7c42-4b17-9954-8ad0a4e2ccba" status: 200 len: 1265 microversion: 2.1 time: 0.153361 Sep 16 02:11:13.267292 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 545/1077] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:11:13 2022] GET /compute/v2.1/servers/db657714-7c42-4b17-9954-8ad0a4e2ccba => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:11:14.289900 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-a5e288d3-1993-4ad1-b541-c8d416388dd5 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:11:14.290542 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-a5e288d3-1993-4ad1-b541-c8d416388dd5 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: db657714-7c42-4b17-9954-8ad0a4e2ccba] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:11:14.297464 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a5e288d3-1993-4ad1-b541-c8d416388dd5 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:14.297941 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a5e288d3-1993-4ad1-b541-c8d416388dd5 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:14.298372 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a5e288d3-1993-4ad1-b541-c8d416388dd5 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:14.299047 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a5e288d3-1993-4ad1-b541-c8d416388dd5 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:14.299496 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a5e288d3-1993-4ad1-b541-c8d416388dd5 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:14.299912 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a5e288d3-1993-4ad1-b541-c8d416388dd5 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:14.427685 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-a5e288d3-1993-4ad1-b541-c8d416388dd5 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:11:14.435249 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-a5e288d3-1993-4ad1-b541-c8d416388dd5 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/db657714-7c42-4b17-9954-8ad0a4e2ccba" status: 200 len: 1265 microversion: 2.1 time: 0.149177 Sep 16 02:11:14.435809 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 533/1078] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:11:14 2022] GET /compute/v2.1/servers/db657714-7c42-4b17-9954-8ad0a4e2ccba => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:11:15.458912 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-f41f249c-7ded-4ee7-a788-11fdac255c42 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:11:15.459532 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-f41f249c-7ded-4ee7-a788-11fdac255c42 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: db657714-7c42-4b17-9954-8ad0a4e2ccba] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:11:15.465970 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f41f249c-7ded-4ee7-a788-11fdac255c42 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:15.466438 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f41f249c-7ded-4ee7-a788-11fdac255c42 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:15.466879 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f41f249c-7ded-4ee7-a788-11fdac255c42 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:15.467596 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f41f249c-7ded-4ee7-a788-11fdac255c42 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:15.468087 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f41f249c-7ded-4ee7-a788-11fdac255c42 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:15.468517 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f41f249c-7ded-4ee7-a788-11fdac255c42 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:15.596033 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-f41f249c-7ded-4ee7-a788-11fdac255c42 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:11:15.603562 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-f41f249c-7ded-4ee7-a788-11fdac255c42 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/db657714-7c42-4b17-9954-8ad0a4e2ccba" status: 200 len: 1265 microversion: 2.1 time: 0.148642 Sep 16 02:11:15.604155 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 546/1079] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:11:15 2022] GET /compute/v2.1/servers/db657714-7c42-4b17-9954-8ad0a4e2ccba => generated 1265 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:11:16.626788 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-f21c43c1-564d-40c0-984b-1fd02bd2bf00 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:11:16.627374 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-f21c43c1-564d-40c0-984b-1fd02bd2bf00 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: db657714-7c42-4b17-9954-8ad0a4e2ccba] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:11:16.629817 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell0:SELECT=2 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:11:16.635361 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f21c43c1-564d-40c0-984b-1fd02bd2bf00 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:16.635873 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f21c43c1-564d-40c0-984b-1fd02bd2bf00 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:16.636349 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f21c43c1-564d-40c0-984b-1fd02bd2bf00 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:16.637031 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f21c43c1-564d-40c0-984b-1fd02bd2bf00 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:16.637476 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f21c43c1-564d-40c0-984b-1fd02bd2bf00 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:16.637893 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f21c43c1-564d-40c0-984b-1fd02bd2bf00 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:16.771922 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-f21c43c1-564d-40c0-984b-1fd02bd2bf00 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:11:16.780494 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-f21c43c1-564d-40c0-984b-1fd02bd2bf00 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/db657714-7c42-4b17-9954-8ad0a4e2ccba" status: 200 len: 1265 microversion: 2.1 time: 0.157092 Sep 16 02:11:16.781048 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 534/1080] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:11:16 2022] GET /compute/v2.1/servers/db657714-7c42-4b17-9954-8ad0a4e2ccba => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:11:17.803324 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-9dc905ee-d5cc-4d2b-ba33-5d5fd1d2005d tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:11:17.804291 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-9dc905ee-d5cc-4d2b-ba33-5d5fd1d2005d tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: db657714-7c42-4b17-9954-8ad0a4e2ccba] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:11:17.807322 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell0:SELECT=2 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:11:17.808113 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell0:SELECT=6 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:11:17.813699 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9dc905ee-d5cc-4d2b-ba33-5d5fd1d2005d tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:17.814254 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9dc905ee-d5cc-4d2b-ba33-5d5fd1d2005d tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:17.814691 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9dc905ee-d5cc-4d2b-ba33-5d5fd1d2005d tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:17.815394 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9dc905ee-d5cc-4d2b-ba33-5d5fd1d2005d tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:17.815851 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9dc905ee-d5cc-4d2b-ba33-5d5fd1d2005d tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:17.816317 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-9dc905ee-d5cc-4d2b-ba33-5d5fd1d2005d tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:17.948259 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-9dc905ee-d5cc-4d2b-ba33-5d5fd1d2005d tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:11:17.956201 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-9dc905ee-d5cc-4d2b-ba33-5d5fd1d2005d tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/db657714-7c42-4b17-9954-8ad0a4e2ccba" status: 200 len: 1265 microversion: 2.1 time: 0.157024 Sep 16 02:11:17.956764 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 547/1081] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:11:17 2022] GET /compute/v2.1/servers/db657714-7c42-4b17-9954-8ad0a4e2ccba => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:11:18.978630 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-ddc170ad-4b12-432c-b43f-022c8536d8bc tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:11:18.979257 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-ddc170ad-4b12-432c-b43f-022c8536d8bc tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: db657714-7c42-4b17-9954-8ad0a4e2ccba] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:11:18.986046 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ddc170ad-4b12-432c-b43f-022c8536d8bc tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:18.986531 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ddc170ad-4b12-432c-b43f-022c8536d8bc tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:18.986973 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ddc170ad-4b12-432c-b43f-022c8536d8bc tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:18.987661 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ddc170ad-4b12-432c-b43f-022c8536d8bc tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:18.988154 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ddc170ad-4b12-432c-b43f-022c8536d8bc tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:18.988584 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ddc170ad-4b12-432c-b43f-022c8536d8bc tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:19.119786 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-ddc170ad-4b12-432c-b43f-022c8536d8bc tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:11:19.128288 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-ddc170ad-4b12-432c-b43f-022c8536d8bc tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/db657714-7c42-4b17-9954-8ad0a4e2ccba" status: 200 len: 1265 microversion: 2.1 time: 0.153545 Sep 16 02:11:19.128857 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 535/1082] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:11:18 2022] GET /compute/v2.1/servers/db657714-7c42-4b17-9954-8ad0a4e2ccba => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:11:20.151502 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-7f126523-5aba-4d27-85e3-8720e1a1d324 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:11:20.152153 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-7f126523-5aba-4d27-85e3-8720e1a1d324 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: db657714-7c42-4b17-9954-8ad0a4e2ccba] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:11:20.159077 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7f126523-5aba-4d27-85e3-8720e1a1d324 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:20.159565 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7f126523-5aba-4d27-85e3-8720e1a1d324 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:20.160035 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7f126523-5aba-4d27-85e3-8720e1a1d324 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:20.160731 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7f126523-5aba-4d27-85e3-8720e1a1d324 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:20.161186 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7f126523-5aba-4d27-85e3-8720e1a1d324 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:20.161611 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7f126523-5aba-4d27-85e3-8720e1a1d324 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:20.293974 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-7f126523-5aba-4d27-85e3-8720e1a1d324 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:11:20.302208 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-7f126523-5aba-4d27-85e3-8720e1a1d324 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/db657714-7c42-4b17-9954-8ad0a4e2ccba" status: 200 len: 1265 microversion: 2.1 time: 0.154535 Sep 16 02:11:20.302797 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 548/1083] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:11:20 2022] GET /compute/v2.1/servers/db657714-7c42-4b17-9954-8ad0a4e2ccba => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:11:21.325795 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-cb7377e8-7213-46b3-8c73-58616fd34d85 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:11:21.326772 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-cb7377e8-7213-46b3-8c73-58616fd34d85 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: db657714-7c42-4b17-9954-8ad0a4e2ccba] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:11:21.333101 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cb7377e8-7213-46b3-8c73-58616fd34d85 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:21.333583 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cb7377e8-7213-46b3-8c73-58616fd34d85 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:21.334019 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cb7377e8-7213-46b3-8c73-58616fd34d85 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:21.334699 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cb7377e8-7213-46b3-8c73-58616fd34d85 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:21.335153 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cb7377e8-7213-46b3-8c73-58616fd34d85 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:21.335576 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cb7377e8-7213-46b3-8c73-58616fd34d85 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:21.462900 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-cb7377e8-7213-46b3-8c73-58616fd34d85 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:11:21.471662 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-cb7377e8-7213-46b3-8c73-58616fd34d85 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/db657714-7c42-4b17-9954-8ad0a4e2ccba" status: 200 len: 1265 microversion: 2.1 time: 0.149751 Sep 16 02:11:21.472259 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 536/1084] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:11:21 2022] GET /compute/v2.1/servers/db657714-7c42-4b17-9954-8ad0a4e2ccba => generated 1265 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:11:21.660805 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [req-d9327dc8-c76e-4642-9466-8b10793a9265 req-334af58f-9c77-4850-b7f2-96243231ccc5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db657714-7c42-4b17-9954-8ad0a4e2ccba", "name": "network-vif-plugged", "status": "completed", "tag": "8cfd42e0-f275-4fb7-b9b7-11b1d2222158"}]} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:11:21.671050 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-d9327dc8-c76e-4642-9466-8b10793a9265 req-334af58f-9c77-4850-b7f2-96243231ccc5 service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:21.671758 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-d9327dc8-c76e-4642-9466-8b10793a9265 req-334af58f-9c77-4850-b7f2-96243231ccc5 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:21.672221 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-d9327dc8-c76e-4642-9466-8b10793a9265 req-334af58f-9c77-4850-b7f2-96243231ccc5 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:21.683330 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.compute.server_external_events [req-d9327dc8-c76e-4642-9466-8b10793a9265 req-334af58f-9c77-4850-b7f2-96243231ccc5 service nova] Creating event network-vif-plugged:8cfd42e0-f275-4fb7-b9b7-11b1d2222158 for instance db657714-7c42-4b17-9954-8ad0a4e2ccba on hv-cinder-84914 Sep 16 02:11:21.688531 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [req-d9327dc8-c76e-4642-9466-8b10793a9265 req-334af58f-9c77-4850-b7f2-96243231ccc5 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031331 Sep 16 02:11:21.689126 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 549/1085] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:11:21 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 02:11:22.493539 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-3aa64bf5-7c24-4f60-ab05-8433bbc911af tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:11:22.494155 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-3aa64bf5-7c24-4f60-ab05-8433bbc911af tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: db657714-7c42-4b17-9954-8ad0a4e2ccba] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:11:22.501645 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3aa64bf5-7c24-4f60-ab05-8433bbc911af tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:22.502129 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3aa64bf5-7c24-4f60-ab05-8433bbc911af tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:22.502570 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3aa64bf5-7c24-4f60-ab05-8433bbc911af tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:22.503248 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3aa64bf5-7c24-4f60-ab05-8433bbc911af tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:22.503701 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3aa64bf5-7c24-4f60-ab05-8433bbc911af tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:22.504156 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3aa64bf5-7c24-4f60-ab05-8433bbc911af tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:22.636355 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-3aa64bf5-7c24-4f60-ab05-8433bbc911af tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:11:22.643953 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-3aa64bf5-7c24-4f60-ab05-8433bbc911af tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/db657714-7c42-4b17-9954-8ad0a4e2ccba" status: 200 len: 1265 microversion: 2.1 time: 0.154335 Sep 16 02:11:22.644526 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 537/1086] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:11:22 2022] GET /compute/v2.1/servers/db657714-7c42-4b17-9954-8ad0a4e2ccba => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:11:23.669384 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-e30cd142-dfbf-4bcf-b57b-b5332b8587a9 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:11:23.669994 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-e30cd142-dfbf-4bcf-b57b-b5332b8587a9 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: db657714-7c42-4b17-9954-8ad0a4e2ccba] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:11:23.678144 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e30cd142-dfbf-4bcf-b57b-b5332b8587a9 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:23.678144 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e30cd142-dfbf-4bcf-b57b-b5332b8587a9 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:23.678518 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e30cd142-dfbf-4bcf-b57b-b5332b8587a9 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:23.679570 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e30cd142-dfbf-4bcf-b57b-b5332b8587a9 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:23.680268 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e30cd142-dfbf-4bcf-b57b-b5332b8587a9 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:23.680859 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e30cd142-dfbf-4bcf-b57b-b5332b8587a9 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:23.834313 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-e30cd142-dfbf-4bcf-b57b-b5332b8587a9 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:11:23.841997 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-e30cd142-dfbf-4bcf-b57b-b5332b8587a9 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/db657714-7c42-4b17-9954-8ad0a4e2ccba" status: 200 len: 1452 microversion: 2.1 time: 0.178746 Sep 16 02:11:23.842676 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 550/1087] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:11:23 2022] GET /compute/v2.1/servers/db657714-7c42-4b17-9954-8ad0a4e2ccba => generated 1452 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:11:23.872112 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-1840df68-94ab-4f45-bf3e-f2de8b7739fc tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:11:23.872813 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-1840df68-94ab-4f45-bf3e-f2de8b7739fc tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: db657714-7c42-4b17-9954-8ad0a4e2ccba] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:11:23.879386 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1840df68-94ab-4f45-bf3e-f2de8b7739fc tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:23.879867 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1840df68-94ab-4f45-bf3e-f2de8b7739fc tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:23.880332 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1840df68-94ab-4f45-bf3e-f2de8b7739fc tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:23.881027 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1840df68-94ab-4f45-bf3e-f2de8b7739fc tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:23.881468 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1840df68-94ab-4f45-bf3e-f2de8b7739fc tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:23.881923 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-1840df68-94ab-4f45-bf3e-f2de8b7739fc tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:24.014559 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-1840df68-94ab-4f45-bf3e-f2de8b7739fc tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:11:24.022432 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-1840df68-94ab-4f45-bf3e-f2de8b7739fc tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/db657714-7c42-4b17-9954-8ad0a4e2ccba" status: 200 len: 1452 microversion: 2.1 time: 0.161809 Sep 16 02:11:24.023009 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 538/1088] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:11:23 2022] GET /compute/v2.1/servers/db657714-7c42-4b17-9954-8ad0a4e2ccba => generated 1452 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:11:25.612621 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [req-26643e3e-98cf-4366-81f5-a19a8f7fa6f5 req-1a9da5cc-b50f-4999-b739-04911a99f594 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db657714-7c42-4b17-9954-8ad0a4e2ccba", "tag": "8cfd42e0-f275-4fb7-b9b7-11b1d2222158"}]} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:11:25.623228 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-26643e3e-98cf-4366-81f5-a19a8f7fa6f5 req-1a9da5cc-b50f-4999-b739-04911a99f594 service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:25.623702 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-26643e3e-98cf-4366-81f5-a19a8f7fa6f5 req-1a9da5cc-b50f-4999-b739-04911a99f594 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:25.624162 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-26643e3e-98cf-4366-81f5-a19a8f7fa6f5 req-1a9da5cc-b50f-4999-b739-04911a99f594 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:25.635440 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.compute.server_external_events [req-26643e3e-98cf-4366-81f5-a19a8f7fa6f5 req-1a9da5cc-b50f-4999-b739-04911a99f594 service nova] Creating event network-changed:8cfd42e0-f275-4fb7-b9b7-11b1d2222158 for instance db657714-7c42-4b17-9954-8ad0a4e2ccba on hv-cinder-84914 Sep 16 02:11:25.642089 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [req-26643e3e-98cf-4366-81f5-a19a8f7fa6f5 req-1a9da5cc-b50f-4999-b739-04911a99f594 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032920 Sep 16 02:11:25.642688 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 551/1089] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:11:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:11:25.763631 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-22f63e88-adf6-4e91-8304-c0d2c6ad7ae0 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:11:25.764914 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-22f63e88-adf6-4e91-8304-c0d2c6ad7ae0 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:11:25.772015 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-22f63e88-adf6-4e91-8304-c0d2c6ad7ae0 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:25.772728 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-22f63e88-adf6-4e91-8304-c0d2c6ad7ae0 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:25.773166 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-22f63e88-adf6-4e91-8304-c0d2c6ad7ae0 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:25.773860 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-22f63e88-adf6-4e91-8304-c0d2c6ad7ae0 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:25.774309 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-22f63e88-adf6-4e91-8304-c0d2c6ad7ae0 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:25.774728 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-22f63e88-adf6-4e91-8304-c0d2c6ad7ae0 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:25.804362 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-22f63e88-adf6-4e91-8304-c0d2c6ad7ae0 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b/ips" status: 200 len: 148 microversion: 2.1 time: 0.044571 Sep 16 02:11:25.809551 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 539/1090] 10.222.0.42 () {58 vars in 1248 bytes} [Fri Sep 16 02:11:25 2022] GET /compute/v2.1/servers/b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b/ips => generated 148 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:11:27.188357 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-993556e8-7250-425f-9319-157f638eded3 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "55392658-3a58-4e3b-9e81-1d35cadc4d22"}} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:11:27.190780 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-993556e8-7250-425f-9319-157f638eded3 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:11:27.197280 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-993556e8-7250-425f-9319-157f638eded3 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:27.197759 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-993556e8-7250-425f-9319-157f638eded3 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:27.198195 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-993556e8-7250-425f-9319-157f638eded3 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:27.198880 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-993556e8-7250-425f-9319-157f638eded3 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:27.199358 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-993556e8-7250-425f-9319-157f638eded3 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:27.199782 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-993556e8-7250-425f-9319-157f638eded3 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:27.465728 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-993556e8-7250-425f-9319-157f638eded3 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "POST /compute/v2.1/servers/b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.281728 Sep 16 02:11:27.466329 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 552/1091] 10.222.0.42 () {60 vars in 1323 bytes} [Fri Sep 16 02:11:27 2022] POST /compute/v2.1/servers/b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b/os-volume_attachments => generated 194 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:11:35.104596 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-432a1307-9e59-4e94-bf51-4ca7ce36d98a tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:11:35.105119 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-432a1307-9e59-4e94-bf51-4ca7ce36d98a tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:11:35.108582 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_api:SELECT=38,nova_api:UPDATE=1 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:11:35.113675 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-432a1307-9e59-4e94-bf51-4ca7ce36d98a tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:35.114195 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-432a1307-9e59-4e94-bf51-4ca7ce36d98a tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:35.114633 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-432a1307-9e59-4e94-bf51-4ca7ce36d98a tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:35.115323 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-432a1307-9e59-4e94-bf51-4ca7ce36d98a tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:35.115783 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-432a1307-9e59-4e94-bf51-4ca7ce36d98a tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:35.116233 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-432a1307-9e59-4e94-bf51-4ca7ce36d98a tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:35.120619 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell1:SELECT=83,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:11:35.197674 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.objects.instance [None req-432a1307-9e59-4e94-bf51-4ca7ce36d98a tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lazy-loading 'services' on Instance uuid b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b {{(pid=120440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 02:11:35.268577 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-432a1307-9e59-4e94-bf51-4ca7ce36d98a tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b/os-volume_attachments/55392658-3a58-4e3b-9e81-1d35cadc4d22" status: 202 len: 0 microversion: 2.1 time: 0.167455 Sep 16 02:11:35.269153 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 540/1092] 10.222.0.42 () {58 vars in 1416 bytes} [Fri Sep 16 02:11:35 2022] DELETE /compute/v2.1/servers/b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b/os-volume_attachments/55392658-3a58-4e3b-9e81-1d35cadc4d22 => generated 0 bytes in 169 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 02:11:35.280279 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-29102473-cb2b-401c-8e9b-8a8b1dad1ce6 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:11:35.282844 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-29102473-cb2b-401c-8e9b-8a8b1dad1ce6 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:11:35.286051 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=3 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:11:35.290603 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-29102473-cb2b-401c-8e9b-8a8b1dad1ce6 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:35.291149 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-29102473-cb2b-401c-8e9b-8a8b1dad1ce6 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:35.291583 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-29102473-cb2b-401c-8e9b-8a8b1dad1ce6 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:35.292312 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-29102473-cb2b-401c-8e9b-8a8b1dad1ce6 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:35.293456 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-29102473-cb2b-401c-8e9b-8a8b1dad1ce6 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:35.293985 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-29102473-cb2b-401c-8e9b-8a8b1dad1ce6 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:35.298407 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell1:SELECT=82,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:11:35.329166 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-29102473-cb2b-401c-8e9b-8a8b1dad1ce6 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055446 Sep 16 02:11:35.329647 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 553/1093] 10.222.0.42 () {58 vars in 1302 bytes} [Fri Sep 16 02:11:35 2022] GET /compute/v2.1/servers/b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:11:36.342540 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-39583317-65fe-46dd-8916-ed0500f35e6c tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:11:36.344937 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-39583317-65fe-46dd-8916-ed0500f35e6c tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:11:36.351534 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-39583317-65fe-46dd-8916-ed0500f35e6c tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:36.352060 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-39583317-65fe-46dd-8916-ed0500f35e6c tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:36.352500 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-39583317-65fe-46dd-8916-ed0500f35e6c tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:36.353188 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-39583317-65fe-46dd-8916-ed0500f35e6c tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:36.353645 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-39583317-65fe-46dd-8916-ed0500f35e6c tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:36.354070 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-39583317-65fe-46dd-8916-ed0500f35e6c tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:36.383530 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-39583317-65fe-46dd-8916-ed0500f35e6c tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045547 Sep 16 02:11:36.384175 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 541/1094] 10.222.0.42 () {58 vars in 1302 bytes} [Fri Sep 16 02:11:36 2022] GET /compute/v2.1/servers/b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 02:11:36.446304 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-08ee9c64-8dca-4e3e-aaf5-9b5e684f0fa4 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:11:36.446831 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-08ee9c64-8dca-4e3e-aaf5-9b5e684f0fa4 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:11:36.453400 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-08ee9c64-8dca-4e3e-aaf5-9b5e684f0fa4 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:36.453882 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-08ee9c64-8dca-4e3e-aaf5-9b5e684f0fa4 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:36.454317 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-08ee9c64-8dca-4e3e-aaf5-9b5e684f0fa4 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:36.455002 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-08ee9c64-8dca-4e3e-aaf5-9b5e684f0fa4 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:36.455455 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-08ee9c64-8dca-4e3e-aaf5-9b5e684f0fa4 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:36.455880 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-08ee9c64-8dca-4e3e-aaf5-9b5e684f0fa4 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:36.480581 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-08ee9c64-8dca-4e3e-aaf5-9b5e684f0fa4 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b] Going to try to terminate instance {{(pid=120441) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 02:11:36.560536 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-08ee9c64-8dca-4e3e-aaf5-9b5e684f0fa4 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b" status: 204 len: 0 microversion: 2.1 time: 0.117254 Sep 16 02:11:36.561518 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 554/1095] 10.222.0.42 () {58 vars in 1239 bytes} [Fri Sep 16 02:11:36 2022] DELETE /compute/v2.1/servers/b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b => generated 0 bytes in 120 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 02:11:36.570494 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-31aa4636-c452-4314-a266-6d799765a0a5 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:11:36.571140 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-31aa4636-c452-4314-a266-6d799765a0a5 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:11:36.581334 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-31aa4636-c452-4314-a266-6d799765a0a5 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:36.581823 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-31aa4636-c452-4314-a266-6d799765a0a5 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:36.582290 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-31aa4636-c452-4314-a266-6d799765a0a5 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:36.582987 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-31aa4636-c452-4314-a266-6d799765a0a5 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:36.583443 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-31aa4636-c452-4314-a266-6d799765a0a5 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:36.583896 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-31aa4636-c452-4314-a266-6d799765a0a5 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:36.711056 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-31aa4636-c452-4314-a266-6d799765a0a5 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:11:36.719318 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-31aa4636-c452-4314-a266-6d799765a0a5 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b" status: 200 len: 1679 microversion: 2.1 time: 0.152688 Sep 16 02:11:36.719881 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 542/1096] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:11:36 2022] GET /compute/v2.1/servers/b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:11:37.744111 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-d54e4ea0-ac90-47c3-99e6-5bfe00e4c2fc tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:11:37.744813 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-d54e4ea0-ac90-47c3-99e6-5bfe00e4c2fc tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:11:37.751868 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d54e4ea0-ac90-47c3-99e6-5bfe00e4c2fc tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:37.752404 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d54e4ea0-ac90-47c3-99e6-5bfe00e4c2fc tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:37.752845 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d54e4ea0-ac90-47c3-99e6-5bfe00e4c2fc tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:37.753530 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d54e4ea0-ac90-47c3-99e6-5bfe00e4c2fc tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:37.753986 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d54e4ea0-ac90-47c3-99e6-5bfe00e4c2fc tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:37.754421 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-d54e4ea0-ac90-47c3-99e6-5bfe00e4c2fc tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:37.881937 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-d54e4ea0-ac90-47c3-99e6-5bfe00e4c2fc tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:11:37.890238 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-d54e4ea0-ac90-47c3-99e6-5bfe00e4c2fc tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b" status: 200 len: 1679 microversion: 2.1 time: 0.150507 Sep 16 02:11:37.890802 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 555/1097] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:11:37 2022] GET /compute/v2.1/servers/b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b => generated 1679 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:11:38.915261 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-774b2db3-0ef8-4957-bfa0-ae34ca5eac8e tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:11:38.916017 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-774b2db3-0ef8-4957-bfa0-ae34ca5eac8e tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:11:38.922931 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-774b2db3-0ef8-4957-bfa0-ae34ca5eac8e tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:38.923416 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-774b2db3-0ef8-4957-bfa0-ae34ca5eac8e tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:38.923849 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-774b2db3-0ef8-4957-bfa0-ae34ca5eac8e tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:38.924571 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-774b2db3-0ef8-4957-bfa0-ae34ca5eac8e tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:38.925029 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-774b2db3-0ef8-4957-bfa0-ae34ca5eac8e tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:38.925457 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-774b2db3-0ef8-4957-bfa0-ae34ca5eac8e tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:39.281180 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-774b2db3-0ef8-4957-bfa0-ae34ca5eac8e tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '86bc1b5163f4453db4469fef90f27344', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '663bde66131d47159ffa09ad33971895', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:11:39.289097 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-774b2db3-0ef8-4957-bfa0-ae34ca5eac8e tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b" status: 200 len: 1679 microversion: 2.1 time: 0.378761 Sep 16 02:11:39.289915 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 543/1098] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:11:38 2022] GET /compute/v2.1/servers/b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b => generated 1679 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:11:39.604942 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [req-5abfcb37-da40-4e63-9c04-4e0e9ab409cf req-2c573c29-a267-4c3c-b71f-ca56d7fac24e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b", "name": "network-vif-deleted", "tag": "f33275e6-6522-40eb-a550-7dce0558702f"}]} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:11:39.615331 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-5abfcb37-da40-4e63-9c04-4e0e9ab409cf req-2c573c29-a267-4c3c-b71f-ca56d7fac24e service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:39.615742 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-5abfcb37-da40-4e63-9c04-4e0e9ab409cf req-2c573c29-a267-4c3c-b71f-ca56d7fac24e service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:39.616217 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-5abfcb37-da40-4e63-9c04-4e0e9ab409cf req-2c573c29-a267-4c3c-b71f-ca56d7fac24e service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:39.628063 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.compute.server_external_events [req-5abfcb37-da40-4e63-9c04-4e0e9ab409cf req-2c573c29-a267-4c3c-b71f-ca56d7fac24e service nova] Creating event network-vif-deleted:f33275e6-6522-40eb-a550-7dce0558702f for instance b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b on hv-cinder-84914 Sep 16 02:11:39.633279 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [req-5abfcb37-da40-4e63-9c04-4e0e9ab409cf req-2c573c29-a267-4c3c-b71f-ca56d7fac24e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031993 Sep 16 02:11:39.634117 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 556/1099] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:11:40.311899 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-16b2f740-d5e3-4baf-97de-30ee9d86fa1d tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:11:40.312557 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-16b2f740-d5e3-4baf-97de-30ee9d86fa1d tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:11:40.319014 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-16b2f740-d5e3-4baf-97de-30ee9d86fa1d tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:40.319507 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-16b2f740-d5e3-4baf-97de-30ee9d86fa1d tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:40.320006 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-16b2f740-d5e3-4baf-97de-30ee9d86fa1d tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:40.320922 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-16b2f740-d5e3-4baf-97de-30ee9d86fa1d tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:40.321383 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-16b2f740-d5e3-4baf-97de-30ee9d86fa1d tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:40.321812 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-16b2f740-d5e3-4baf-97de-30ee9d86fa1d tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:40.336584 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.wsgi [None req-16b2f740-d5e3-4baf-97de-30ee9d86fa1d tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] HTTP exception thrown: Instance b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b could not be found. Sep 16 02:11:40.338301 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-16b2f740-d5e3-4baf-97de-30ee9d86fa1d tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Request method failure captured: Sep 16 02:11:40.338301 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: request: GET /compute/v2.1/servers/b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b HTTP/1.1 Sep 16 02:11:40.338301 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept: application/json Sep 16 02:11:40.338301 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept-Encoding: identity Sep 16 02:11:40.338301 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Connection: close Sep 16 02:11:40.338301 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Length: 0 Sep 16 02:11:40.338301 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Type: application/json Sep 16 02:11:40.338301 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Host: 10.222.0.42 Sep 16 02:11:40.338301 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Openstack-System-Scope: None Sep 16 02:11:40.338301 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: User-Agent: python-urllib3/1.26.12 Sep 16 02:11:40.338301 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Auth-Token: gAAAAABjI9mx6m5YD-VfbXTdOVSmd4NGFLNahGaBbLMo1peJ92wbDVmYwuc5RZgaFUZEqbCVEZU6kOmxNdBXGglNvRlzGtU8he2rrBc7XBc5oNHv9HVVP2iJXpOeBFUkIrXZgk5pRb1fDXNxk7RrwhUPrzMT1uDUBmKj9juzpqGuTgd9rytxkwc Sep 16 02:11:40.338301 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Id: None Sep 16 02:11:40.338301 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Name: None Sep 16 02:11:40.338301 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Identity-Status: Confirmed Sep 16 02:11:40.338301 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Is-Admin-Project: True Sep 16 02:11:40.338301 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Id: default Sep 16 02:11:40.338301 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Name: Default Sep 16 02:11:40.338301 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Id: 663bde66131d47159ffa09ad33971895 Sep 16 02:11:40.338301 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Name: tempest-AttachVolumeNegativeTest-651370638 Sep 16 02:11:40.338301 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Role: member,reader Sep 16 02:11:40.338301 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Roles: member,reader Sep 16 02:11:40.339981 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/663bde66131d47159ffa09ad33971895"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/663bde66131d47159ffa09ad33971895"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_663bde66131d47159ffa09ad33971895"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/663bde66131d47159ffa09ad33971895"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 02:11:40.339981 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant: tempest-AttachVolumeNegativeTest-651370638 Sep 16 02:11:40.339981 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Id: 663bde66131d47159ffa09ad33971895 Sep 16 02:11:40.339981 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-651370638 Sep 16 02:11:40.339981 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User: tempest-AttachVolumeNegativeTest-651370638-project Sep 16 02:11:40.339981 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Id: default Sep 16 02:11:40.339981 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Name: Default Sep 16 02:11:40.339981 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Id: 86bc1b5163f4453db4469fef90f27344 Sep 16 02:11:40.339981 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Name: tempest-AttachVolumeNegativeTest-651370638-project Sep 16 02:11:40.339981 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: method: > Sep 16 02:11:40.339981 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: exception: Instance b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b could not be found. Sep 16 02:11:40.339981 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: action_args: {'id': 'b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b'} Sep 16 02:11:40.340916 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 02:11:40.340916 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:11:40.340916 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 02:11:40.340916 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 02:11:40.340916 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 02:11:40.340916 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 02:11:40.340916 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 02:11:40.340916 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 02:11:40.340916 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 02:11:40.340916 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 02:11:40.340916 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b could not be found. Sep 16 02:11:40.340916 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:11:40.340916 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:11:40.340916 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:11:40.340916 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:11:40.340916 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:11:40.340916 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:11:40.340916 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 02:11:40.340916 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 02:11:40.340916 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 02:11:40.343087 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 02:11:40.343087 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 02:11:40.343087 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 02:11:40.343087 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 02:11:40.343087 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 02:11:40.343087 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 02:11:40.343087 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 02:11:40.343087 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b could not be found. Sep 16 02:11:40.343087 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:11:40.343087 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:11:40.343087 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:11:40.343087 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:11:40.343087 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:11:40.343087 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:11:40.343087 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 02:11:40.343087 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 02:11:40.343087 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b could not be found. Sep 16 02:11:40.343087 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:11:40.344483 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-16b2f740-d5e3-4baf-97de-30ee9d86fa1d tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Returning 404 to user: Instance b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b could not be found. {{(pid=120440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 02:11:40.344483 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-16b2f740-d5e3-4baf-97de-30ee9d86fa1d tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b" status: 404 len: 111 microversion: 2.1 time: 0.031873 Sep 16 02:11:40.344483 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 544/1100] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:11:40 2022] GET /compute/v2.1/servers/b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 02:11:40.350226 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-7dd6f23d-9f5b-410c-84d6-cc558f3f8c5e tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '.version_select at 0x7fae36223160>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:11:40.370593 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-7dd6f23d-9f5b-410c-84d6-cc558f3f8c5e tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-643125845" status: 202 len: 0 microversion: 2.1 time: 0.024503 Sep 16 02:11:40.371427 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 557/1101] 10.222.0.42 () {58 vars in 1218 bytes} [Fri Sep 16 02:11:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-643125845 => generated 0 bytes in 26 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 02:11:42.141011 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-443bf51e-2857-4aeb-8279-fdaef9ad0f04 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:11:42.141565 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-443bf51e-2857-4aeb-8279-fdaef9ad0f04 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:11:42.147854 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-443bf51e-2857-4aeb-8279-fdaef9ad0f04 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:42.148382 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-443bf51e-2857-4aeb-8279-fdaef9ad0f04 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:42.148816 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-443bf51e-2857-4aeb-8279-fdaef9ad0f04 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:42.149499 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-443bf51e-2857-4aeb-8279-fdaef9ad0f04 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:42.149952 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-443bf51e-2857-4aeb-8279-fdaef9ad0f04 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:42.150372 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-443bf51e-2857-4aeb-8279-fdaef9ad0f04 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:42.164245 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.wsgi [None req-443bf51e-2857-4aeb-8279-fdaef9ad0f04 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] HTTP exception thrown: Instance b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b could not be found. Sep 16 02:11:42.165801 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-443bf51e-2857-4aeb-8279-fdaef9ad0f04 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Request method failure captured: Sep 16 02:11:42.165801 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: request: DELETE /compute/v2.1/servers/b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b HTTP/1.1 Sep 16 02:11:42.165801 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept: application/json Sep 16 02:11:42.165801 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept-Encoding: identity Sep 16 02:11:42.165801 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Connection: close Sep 16 02:11:42.165801 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Length: 0 Sep 16 02:11:42.165801 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Type: application/json Sep 16 02:11:42.165801 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Host: 10.222.0.42 Sep 16 02:11:42.165801 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Openstack-System-Scope: None Sep 16 02:11:42.165801 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: User-Agent: python-urllib3/1.26.12 Sep 16 02:11:42.165801 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Auth-Token: gAAAAABjI9mx6m5YD-VfbXTdOVSmd4NGFLNahGaBbLMo1peJ92wbDVmYwuc5RZgaFUZEqbCVEZU6kOmxNdBXGglNvRlzGtU8he2rrBc7XBc5oNHv9HVVP2iJXpOeBFUkIrXZgk5pRb1fDXNxk7RrwhUPrzMT1uDUBmKj9juzpqGuTgd9rytxkwc Sep 16 02:11:42.165801 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Id: None Sep 16 02:11:42.165801 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Name: None Sep 16 02:11:42.165801 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Identity-Status: Confirmed Sep 16 02:11:42.165801 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Is-Admin-Project: True Sep 16 02:11:42.165801 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Id: default Sep 16 02:11:42.165801 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Name: Default Sep 16 02:11:42.165801 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Id: 663bde66131d47159ffa09ad33971895 Sep 16 02:11:42.165801 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Name: tempest-AttachVolumeNegativeTest-651370638 Sep 16 02:11:42.165801 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Role: member,reader Sep 16 02:11:42.165801 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Roles: member,reader Sep 16 02:11:42.167166 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/663bde66131d47159ffa09ad33971895"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/663bde66131d47159ffa09ad33971895"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_663bde66131d47159ffa09ad33971895"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/663bde66131d47159ffa09ad33971895"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 02:11:42.167166 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant: tempest-AttachVolumeNegativeTest-651370638 Sep 16 02:11:42.167166 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Id: 663bde66131d47159ffa09ad33971895 Sep 16 02:11:42.167166 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-651370638 Sep 16 02:11:42.167166 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User: tempest-AttachVolumeNegativeTest-651370638-project Sep 16 02:11:42.167166 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Id: default Sep 16 02:11:42.167166 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Name: Default Sep 16 02:11:42.167166 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Id: 86bc1b5163f4453db4469fef90f27344 Sep 16 02:11:42.167166 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Name: tempest-AttachVolumeNegativeTest-651370638-project Sep 16 02:11:42.167166 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: method: > Sep 16 02:11:42.167166 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: exception: Instance b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b could not be found. Sep 16 02:11:42.167166 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: action_args: {'id': 'b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b'} Sep 16 02:11:42.168020 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 02:11:42.168020 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:11:42.168020 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 02:11:42.168020 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 02:11:42.168020 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 02:11:42.168020 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 02:11:42.168020 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 02:11:42.168020 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 02:11:42.168020 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 02:11:42.168020 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 02:11:42.168020 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b could not be found. Sep 16 02:11:42.168020 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:11:42.168020 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:11:42.168020 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:11:42.168020 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:11:42.168020 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:11:42.168020 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:11:42.168020 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 02:11:42.168020 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 02:11:42.168020 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 02:11:42.169748 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 02:11:42.169748 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 02:11:42.169748 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 02:11:42.169748 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 02:11:42.169748 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 02:11:42.169748 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 02:11:42.169748 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 02:11:42.169748 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 02:11:42.169748 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 02:11:42.169748 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b could not be found. Sep 16 02:11:42.169748 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:11:42.169748 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:11:42.169748 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:11:42.169748 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:11:42.169748 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:11:42.169748 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:11:42.169748 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 02:11:42.169748 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 02:11:42.169748 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b could not be found. Sep 16 02:11:42.169748 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:11:42.171378 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-443bf51e-2857-4aeb-8279-fdaef9ad0f04 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Returning 404 to user: Instance b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b could not be found. {{(pid=120440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 02:11:42.171378 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-443bf51e-2857-4aeb-8279-fdaef9ad0f04 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "DELETE /compute/v2.1/servers/b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b" status: 404 len: 111 microversion: 2.1 time: 0.030830 Sep 16 02:11:42.171378 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 545/1102] 10.222.0.42 () {58 vars in 1239 bytes} [Fri Sep 16 02:11:42 2022] DELETE /compute/v2.1/servers/b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 02:11:42.176163 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-43b76518-6dc3-47ca-a0d5-0d3e4e8b17ec tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:11:42.176904 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-43b76518-6dc3-47ca-a0d5-0d3e4e8b17ec tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:11:42.183410 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-43b76518-6dc3-47ca-a0d5-0d3e4e8b17ec tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:42.183896 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-43b76518-6dc3-47ca-a0d5-0d3e4e8b17ec tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:42.184359 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-43b76518-6dc3-47ca-a0d5-0d3e4e8b17ec tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:42.185076 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-43b76518-6dc3-47ca-a0d5-0d3e4e8b17ec tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:42.185666 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-43b76518-6dc3-47ca-a0d5-0d3e4e8b17ec tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:42.186100 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-43b76518-6dc3-47ca-a0d5-0d3e4e8b17ec tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:42.199099 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.wsgi [None req-43b76518-6dc3-47ca-a0d5-0d3e4e8b17ec tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] HTTP exception thrown: Instance b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b could not be found. Sep 16 02:11:42.201556 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-43b76518-6dc3-47ca-a0d5-0d3e4e8b17ec tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Request method failure captured: Sep 16 02:11:42.201556 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: request: GET /compute/v2.1/servers/b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b HTTP/1.1 Sep 16 02:11:42.201556 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Accept: application/json Sep 16 02:11:42.201556 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Accept-Encoding: identity Sep 16 02:11:42.201556 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Connection: close Sep 16 02:11:42.201556 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Content-Length: 0 Sep 16 02:11:42.201556 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Content-Type: application/json Sep 16 02:11:42.201556 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Host: 10.222.0.42 Sep 16 02:11:42.201556 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Openstack-System-Scope: None Sep 16 02:11:42.201556 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: User-Agent: python-urllib3/1.26.12 Sep 16 02:11:42.201556 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Auth-Token: gAAAAABjI9mx6m5YD-VfbXTdOVSmd4NGFLNahGaBbLMo1peJ92wbDVmYwuc5RZgaFUZEqbCVEZU6kOmxNdBXGglNvRlzGtU8he2rrBc7XBc5oNHv9HVVP2iJXpOeBFUkIrXZgk5pRb1fDXNxk7RrwhUPrzMT1uDUBmKj9juzpqGuTgd9rytxkwc Sep 16 02:11:42.201556 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Domain-Id: None Sep 16 02:11:42.201556 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Domain-Name: None Sep 16 02:11:42.201556 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Identity-Status: Confirmed Sep 16 02:11:42.201556 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Is-Admin-Project: True Sep 16 02:11:42.201556 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Domain-Id: default Sep 16 02:11:42.201556 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Domain-Name: Default Sep 16 02:11:42.201556 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Id: 663bde66131d47159ffa09ad33971895 Sep 16 02:11:42.201556 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Name: tempest-AttachVolumeNegativeTest-651370638 Sep 16 02:11:42.201556 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Role: member,reader Sep 16 02:11:42.201556 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Roles: member,reader Sep 16 02:11:42.203169 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/663bde66131d47159ffa09ad33971895"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/663bde66131d47159ffa09ad33971895"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_663bde66131d47159ffa09ad33971895"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/663bde66131d47159ffa09ad33971895"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 02:11:42.203169 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant: tempest-AttachVolumeNegativeTest-651370638 Sep 16 02:11:42.203169 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant-Id: 663bde66131d47159ffa09ad33971895 Sep 16 02:11:42.203169 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-651370638 Sep 16 02:11:42.203169 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User: tempest-AttachVolumeNegativeTest-651370638-project Sep 16 02:11:42.203169 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Domain-Id: default Sep 16 02:11:42.203169 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Domain-Name: Default Sep 16 02:11:42.203169 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Id: 86bc1b5163f4453db4469fef90f27344 Sep 16 02:11:42.203169 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Name: tempest-AttachVolumeNegativeTest-651370638-project Sep 16 02:11:42.203169 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: method: > Sep 16 02:11:42.203169 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: exception: Instance b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b could not be found. Sep 16 02:11:42.203169 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: action_args: {'id': 'b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b'} Sep 16 02:11:42.204112 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 02:11:42.204112 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:11:42.204112 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 02:11:42.204112 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 02:11:42.204112 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 02:11:42.204112 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 02:11:42.204112 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 02:11:42.204112 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 02:11:42.204112 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 02:11:42.204112 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 02:11:42.204112 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b could not be found. Sep 16 02:11:42.204112 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:11:42.204112 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:11:42.204112 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:11:42.204112 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:11:42.204112 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:11:42.204112 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:11:42.204112 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 02:11:42.204112 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 02:11:42.204112 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 02:11:42.205602 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 02:11:42.205602 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 02:11:42.205602 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 02:11:42.205602 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 02:11:42.205602 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 02:11:42.205602 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 02:11:42.205602 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 02:11:42.205602 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b could not be found. Sep 16 02:11:42.205602 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:11:42.205602 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:11:42.205602 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:11:42.205602 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:11:42.205602 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:11:42.205602 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:11:42.205602 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 02:11:42.205602 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 02:11:42.205602 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b could not be found. Sep 16 02:11:42.205602 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:11:42.206997 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-43b76518-6dc3-47ca-a0d5-0d3e4e8b17ec tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Returning 404 to user: Instance b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b could not be found. {{(pid=120441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 02:11:42.206997 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-43b76518-6dc3-47ca-a0d5-0d3e4e8b17ec tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b" status: 404 len: 111 microversion: 2.1 time: 0.031182 Sep 16 02:11:42.206997 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 558/1103] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:11:42 2022] GET /compute/v2.1/servers/b63e95fb-8d69-4f87-9eb0-b02c7f1b3c3b => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 02:11:43.341924 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-6d16347d-ab5e-4941-bb51-0bd14a923d6a tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:11:43.342424 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-6d16347d-ab5e-4941-bb51-0bd14a923d6a tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: a3d82b31-1f43-429e-84a1-483acae4dbac] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:11:43.348780 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6d16347d-ab5e-4941-bb51-0bd14a923d6a tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:43.349257 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6d16347d-ab5e-4941-bb51-0bd14a923d6a tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:43.349691 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6d16347d-ab5e-4941-bb51-0bd14a923d6a tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:43.350371 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6d16347d-ab5e-4941-bb51-0bd14a923d6a tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:43.350822 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6d16347d-ab5e-4941-bb51-0bd14a923d6a tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:43.351247 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6d16347d-ab5e-4941-bb51-0bd14a923d6a tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:43.364349 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.wsgi [None req-6d16347d-ab5e-4941-bb51-0bd14a923d6a tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] HTTP exception thrown: Instance a3d82b31-1f43-429e-84a1-483acae4dbac could not be found. Sep 16 02:11:43.365869 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-6d16347d-ab5e-4941-bb51-0bd14a923d6a tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Request method failure captured: Sep 16 02:11:43.365869 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: request: DELETE /compute/v2.1/servers/a3d82b31-1f43-429e-84a1-483acae4dbac HTTP/1.1 Sep 16 02:11:43.365869 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept: application/json Sep 16 02:11:43.365869 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept-Encoding: identity Sep 16 02:11:43.365869 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Connection: close Sep 16 02:11:43.365869 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Length: 0 Sep 16 02:11:43.365869 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Type: application/json Sep 16 02:11:43.365869 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Host: 10.222.0.42 Sep 16 02:11:43.365869 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Openstack-System-Scope: None Sep 16 02:11:43.365869 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: User-Agent: python-urllib3/1.26.12 Sep 16 02:11:43.365869 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Auth-Token: gAAAAABjI9mx6m5YD-VfbXTdOVSmd4NGFLNahGaBbLMo1peJ92wbDVmYwuc5RZgaFUZEqbCVEZU6kOmxNdBXGglNvRlzGtU8he2rrBc7XBc5oNHv9HVVP2iJXpOeBFUkIrXZgk5pRb1fDXNxk7RrwhUPrzMT1uDUBmKj9juzpqGuTgd9rytxkwc Sep 16 02:11:43.365869 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Id: None Sep 16 02:11:43.365869 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Name: None Sep 16 02:11:43.365869 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Identity-Status: Confirmed Sep 16 02:11:43.365869 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Is-Admin-Project: True Sep 16 02:11:43.365869 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Id: default Sep 16 02:11:43.365869 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Name: Default Sep 16 02:11:43.365869 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Id: 663bde66131d47159ffa09ad33971895 Sep 16 02:11:43.365869 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Name: tempest-AttachVolumeNegativeTest-651370638 Sep 16 02:11:43.365869 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Role: member,reader Sep 16 02:11:43.365869 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Roles: member,reader Sep 16 02:11:43.367453 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/663bde66131d47159ffa09ad33971895"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/663bde66131d47159ffa09ad33971895"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_663bde66131d47159ffa09ad33971895"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/663bde66131d47159ffa09ad33971895"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 02:11:43.367453 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant: tempest-AttachVolumeNegativeTest-651370638 Sep 16 02:11:43.367453 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Id: 663bde66131d47159ffa09ad33971895 Sep 16 02:11:43.367453 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-651370638 Sep 16 02:11:43.367453 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User: tempest-AttachVolumeNegativeTest-651370638-project Sep 16 02:11:43.367453 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Id: default Sep 16 02:11:43.367453 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Name: Default Sep 16 02:11:43.367453 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Id: 86bc1b5163f4453db4469fef90f27344 Sep 16 02:11:43.367453 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Name: tempest-AttachVolumeNegativeTest-651370638-project Sep 16 02:11:43.367453 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: method: > Sep 16 02:11:43.367453 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: exception: Instance a3d82b31-1f43-429e-84a1-483acae4dbac could not be found. Sep 16 02:11:43.367453 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: action_args: {'id': 'a3d82b31-1f43-429e-84a1-483acae4dbac'} Sep 16 02:11:43.368318 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 02:11:43.368318 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:11:43.368318 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 02:11:43.368318 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 02:11:43.368318 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 02:11:43.368318 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 02:11:43.368318 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 02:11:43.368318 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 02:11:43.368318 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 02:11:43.368318 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 02:11:43.368318 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3d82b31-1f43-429e-84a1-483acae4dbac could not be found. Sep 16 02:11:43.368318 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:11:43.368318 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:11:43.368318 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:11:43.368318 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:11:43.368318 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:11:43.368318 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:11:43.368318 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 02:11:43.368318 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 02:11:43.368318 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 02:11:43.369726 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 02:11:43.369726 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 02:11:43.369726 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 02:11:43.369726 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 02:11:43.369726 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 02:11:43.369726 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 02:11:43.369726 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 02:11:43.369726 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 02:11:43.369726 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 02:11:43.369726 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3d82b31-1f43-429e-84a1-483acae4dbac could not be found. Sep 16 02:11:43.369726 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:11:43.369726 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:11:43.369726 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:11:43.369726 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:11:43.369726 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:11:43.369726 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:11:43.369726 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 02:11:43.369726 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 02:11:43.369726 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3d82b31-1f43-429e-84a1-483acae4dbac could not be found. Sep 16 02:11:43.369726 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:11:43.371262 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-6d16347d-ab5e-4941-bb51-0bd14a923d6a tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Returning 404 to user: Instance a3d82b31-1f43-429e-84a1-483acae4dbac could not be found. {{(pid=120440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 02:11:43.371262 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-6d16347d-ab5e-4941-bb51-0bd14a923d6a tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "DELETE /compute/v2.1/servers/a3d82b31-1f43-429e-84a1-483acae4dbac" status: 404 len: 111 microversion: 2.1 time: 0.029234 Sep 16 02:11:43.371262 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 546/1104] 10.222.0.42 () {58 vars in 1239 bytes} [Fri Sep 16 02:11:43 2022] DELETE /compute/v2.1/servers/a3d82b31-1f43-429e-84a1-483acae4dbac => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 02:11:43.376820 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-f4dc3b2b-ac8a-4981-95dd-de95f2e5674f tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:11:43.377440 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-f4dc3b2b-ac8a-4981-95dd-de95f2e5674f tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: a3d82b31-1f43-429e-84a1-483acae4dbac] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:11:43.383710 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f4dc3b2b-ac8a-4981-95dd-de95f2e5674f tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:43.384233 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f4dc3b2b-ac8a-4981-95dd-de95f2e5674f tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:43.384674 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f4dc3b2b-ac8a-4981-95dd-de95f2e5674f tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:43.385364 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f4dc3b2b-ac8a-4981-95dd-de95f2e5674f tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:43.385815 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f4dc3b2b-ac8a-4981-95dd-de95f2e5674f tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:43.386240 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f4dc3b2b-ac8a-4981-95dd-de95f2e5674f tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:43.399919 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.wsgi [None req-f4dc3b2b-ac8a-4981-95dd-de95f2e5674f tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] HTTP exception thrown: Instance a3d82b31-1f43-429e-84a1-483acae4dbac could not be found. Sep 16 02:11:43.401450 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-f4dc3b2b-ac8a-4981-95dd-de95f2e5674f tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Request method failure captured: Sep 16 02:11:43.401450 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: request: GET /compute/v2.1/servers/a3d82b31-1f43-429e-84a1-483acae4dbac HTTP/1.1 Sep 16 02:11:43.401450 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Accept: application/json Sep 16 02:11:43.401450 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Accept-Encoding: identity Sep 16 02:11:43.401450 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Connection: close Sep 16 02:11:43.401450 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Content-Length: 0 Sep 16 02:11:43.401450 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Content-Type: application/json Sep 16 02:11:43.401450 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Host: 10.222.0.42 Sep 16 02:11:43.401450 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Openstack-System-Scope: None Sep 16 02:11:43.401450 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: User-Agent: python-urllib3/1.26.12 Sep 16 02:11:43.401450 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Auth-Token: gAAAAABjI9mx6m5YD-VfbXTdOVSmd4NGFLNahGaBbLMo1peJ92wbDVmYwuc5RZgaFUZEqbCVEZU6kOmxNdBXGglNvRlzGtU8he2rrBc7XBc5oNHv9HVVP2iJXpOeBFUkIrXZgk5pRb1fDXNxk7RrwhUPrzMT1uDUBmKj9juzpqGuTgd9rytxkwc Sep 16 02:11:43.401450 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Domain-Id: None Sep 16 02:11:43.401450 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Domain-Name: None Sep 16 02:11:43.401450 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Identity-Status: Confirmed Sep 16 02:11:43.401450 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Is-Admin-Project: True Sep 16 02:11:43.401450 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Domain-Id: default Sep 16 02:11:43.401450 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Domain-Name: Default Sep 16 02:11:43.401450 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Id: 663bde66131d47159ffa09ad33971895 Sep 16 02:11:43.401450 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Name: tempest-AttachVolumeNegativeTest-651370638 Sep 16 02:11:43.401450 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Role: member,reader Sep 16 02:11:43.401450 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Roles: member,reader Sep 16 02:11:43.403041 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/663bde66131d47159ffa09ad33971895"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/663bde66131d47159ffa09ad33971895"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_663bde66131d47159ffa09ad33971895"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/663bde66131d47159ffa09ad33971895"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 02:11:43.403041 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant: tempest-AttachVolumeNegativeTest-651370638 Sep 16 02:11:43.403041 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant-Id: 663bde66131d47159ffa09ad33971895 Sep 16 02:11:43.403041 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-651370638 Sep 16 02:11:43.403041 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User: tempest-AttachVolumeNegativeTest-651370638-project Sep 16 02:11:43.403041 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Domain-Id: default Sep 16 02:11:43.403041 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Domain-Name: Default Sep 16 02:11:43.403041 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Id: 86bc1b5163f4453db4469fef90f27344 Sep 16 02:11:43.403041 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Name: tempest-AttachVolumeNegativeTest-651370638-project Sep 16 02:11:43.403041 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: method: > Sep 16 02:11:43.403041 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: exception: Instance a3d82b31-1f43-429e-84a1-483acae4dbac could not be found. Sep 16 02:11:43.403041 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: action_args: {'id': 'a3d82b31-1f43-429e-84a1-483acae4dbac'} Sep 16 02:11:43.403981 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 02:11:43.403981 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:11:43.403981 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 02:11:43.403981 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 02:11:43.403981 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 02:11:43.403981 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 02:11:43.403981 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 02:11:43.403981 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 02:11:43.403981 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 02:11:43.403981 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 02:11:43.403981 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a3d82b31-1f43-429e-84a1-483acae4dbac could not be found. Sep 16 02:11:43.403981 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:11:43.403981 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:11:43.403981 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:11:43.403981 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:11:43.403981 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:11:43.403981 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:11:43.403981 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 02:11:43.403981 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 02:11:43.403981 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 02:11:43.405842 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 02:11:43.405842 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 02:11:43.405842 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 02:11:43.405842 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 02:11:43.405842 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 02:11:43.405842 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 02:11:43.405842 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 02:11:43.405842 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a3d82b31-1f43-429e-84a1-483acae4dbac could not be found. Sep 16 02:11:43.405842 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:11:43.405842 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:11:43.405842 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:11:43.405842 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:11:43.405842 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:11:43.405842 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:11:43.405842 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 02:11:43.405842 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 02:11:43.405842 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a3d82b31-1f43-429e-84a1-483acae4dbac could not be found. Sep 16 02:11:43.405842 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:11:43.407263 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-f4dc3b2b-ac8a-4981-95dd-de95f2e5674f tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Returning 404 to user: Instance a3d82b31-1f43-429e-84a1-483acae4dbac could not be found. {{(pid=120441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 02:11:43.407263 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-f4dc3b2b-ac8a-4981-95dd-de95f2e5674f tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/a3d82b31-1f43-429e-84a1-483acae4dbac" status: 404 len: 111 microversion: 2.1 time: 0.031155 Sep 16 02:11:43.407263 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 559/1105] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:11:43 2022] GET /compute/v2.1/servers/a3d82b31-1f43-429e-84a1-483acae4dbac => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 02:11:43.411124 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-fc0f4096-49b8-4099-a165-863bd368e1fb tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:11:43.411616 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-fc0f4096-49b8-4099-a165-863bd368e1fb tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: 6dcfb746-60d5-48b0-ab19-2d7a235860df] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:11:43.417481 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-fc0f4096-49b8-4099-a165-863bd368e1fb tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:43.417952 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-fc0f4096-49b8-4099-a165-863bd368e1fb tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:43.418380 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-fc0f4096-49b8-4099-a165-863bd368e1fb tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:43.419054 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-fc0f4096-49b8-4099-a165-863bd368e1fb tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:43.419501 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-fc0f4096-49b8-4099-a165-863bd368e1fb tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:43.420100 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-fc0f4096-49b8-4099-a165-863bd368e1fb tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:43.433167 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.wsgi [None req-fc0f4096-49b8-4099-a165-863bd368e1fb tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] HTTP exception thrown: Instance 6dcfb746-60d5-48b0-ab19-2d7a235860df could not be found. Sep 16 02:11:43.434660 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-fc0f4096-49b8-4099-a165-863bd368e1fb tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Request method failure captured: Sep 16 02:11:43.434660 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: request: DELETE /compute/v2.1/servers/6dcfb746-60d5-48b0-ab19-2d7a235860df HTTP/1.1 Sep 16 02:11:43.434660 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept: application/json Sep 16 02:11:43.434660 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept-Encoding: identity Sep 16 02:11:43.434660 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Connection: close Sep 16 02:11:43.434660 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Length: 0 Sep 16 02:11:43.434660 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Type: application/json Sep 16 02:11:43.434660 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Host: 10.222.0.42 Sep 16 02:11:43.434660 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Openstack-System-Scope: None Sep 16 02:11:43.434660 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: User-Agent: python-urllib3/1.26.12 Sep 16 02:11:43.434660 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Auth-Token: gAAAAABjI9mx6m5YD-VfbXTdOVSmd4NGFLNahGaBbLMo1peJ92wbDVmYwuc5RZgaFUZEqbCVEZU6kOmxNdBXGglNvRlzGtU8he2rrBc7XBc5oNHv9HVVP2iJXpOeBFUkIrXZgk5pRb1fDXNxk7RrwhUPrzMT1uDUBmKj9juzpqGuTgd9rytxkwc Sep 16 02:11:43.434660 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Id: None Sep 16 02:11:43.434660 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Name: None Sep 16 02:11:43.434660 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Identity-Status: Confirmed Sep 16 02:11:43.434660 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Is-Admin-Project: True Sep 16 02:11:43.434660 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Id: default Sep 16 02:11:43.434660 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Name: Default Sep 16 02:11:43.434660 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Id: 663bde66131d47159ffa09ad33971895 Sep 16 02:11:43.434660 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Name: tempest-AttachVolumeNegativeTest-651370638 Sep 16 02:11:43.434660 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Role: member,reader Sep 16 02:11:43.434660 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Roles: member,reader Sep 16 02:11:43.436850 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/663bde66131d47159ffa09ad33971895"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/663bde66131d47159ffa09ad33971895"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_663bde66131d47159ffa09ad33971895"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/663bde66131d47159ffa09ad33971895"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 02:11:43.436850 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant: tempest-AttachVolumeNegativeTest-651370638 Sep 16 02:11:43.436850 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Id: 663bde66131d47159ffa09ad33971895 Sep 16 02:11:43.436850 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-651370638 Sep 16 02:11:43.436850 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User: tempest-AttachVolumeNegativeTest-651370638-project Sep 16 02:11:43.436850 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Id: default Sep 16 02:11:43.436850 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Name: Default Sep 16 02:11:43.436850 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Id: 86bc1b5163f4453db4469fef90f27344 Sep 16 02:11:43.436850 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Name: tempest-AttachVolumeNegativeTest-651370638-project Sep 16 02:11:43.436850 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: method: > Sep 16 02:11:43.436850 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: exception: Instance 6dcfb746-60d5-48b0-ab19-2d7a235860df could not be found. Sep 16 02:11:43.436850 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: action_args: {'id': '6dcfb746-60d5-48b0-ab19-2d7a235860df'} Sep 16 02:11:43.437749 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 02:11:43.437749 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:11:43.437749 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 02:11:43.437749 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 02:11:43.437749 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 02:11:43.437749 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 02:11:43.437749 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 02:11:43.437749 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 02:11:43.437749 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 02:11:43.437749 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 02:11:43.437749 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dcfb746-60d5-48b0-ab19-2d7a235860df could not be found. Sep 16 02:11:43.437749 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:11:43.437749 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:11:43.437749 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:11:43.437749 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:11:43.437749 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:11:43.437749 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:11:43.437749 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 02:11:43.437749 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 02:11:43.437749 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 02:11:43.439253 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 02:11:43.439253 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 02:11:43.439253 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 02:11:43.439253 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 02:11:43.439253 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 02:11:43.439253 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 02:11:43.439253 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 02:11:43.439253 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 02:11:43.439253 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 02:11:43.439253 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dcfb746-60d5-48b0-ab19-2d7a235860df could not be found. Sep 16 02:11:43.439253 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:11:43.439253 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:11:43.439253 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:11:43.439253 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:11:43.439253 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:11:43.439253 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:11:43.439253 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 02:11:43.439253 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 02:11:43.439253 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dcfb746-60d5-48b0-ab19-2d7a235860df could not be found. Sep 16 02:11:43.439253 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:11:43.441090 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-fc0f4096-49b8-4099-a165-863bd368e1fb tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Returning 404 to user: Instance 6dcfb746-60d5-48b0-ab19-2d7a235860df could not be found. {{(pid=120440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 02:11:43.441090 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-fc0f4096-49b8-4099-a165-863bd368e1fb tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "DELETE /compute/v2.1/servers/6dcfb746-60d5-48b0-ab19-2d7a235860df" status: 404 len: 111 microversion: 2.1 time: 0.029372 Sep 16 02:11:43.441090 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 547/1106] 10.222.0.42 () {58 vars in 1239 bytes} [Fri Sep 16 02:11:43 2022] DELETE /compute/v2.1/servers/6dcfb746-60d5-48b0-ab19-2d7a235860df => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 02:11:43.445056 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-a4fc9d55-225f-41fd-9360-4ffb505712db tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:11:43.445672 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-a4fc9d55-225f-41fd-9360-4ffb505712db tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: 6dcfb746-60d5-48b0-ab19-2d7a235860df] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:11:43.451554 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a4fc9d55-225f-41fd-9360-4ffb505712db tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:43.452062 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a4fc9d55-225f-41fd-9360-4ffb505712db tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:43.452502 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a4fc9d55-225f-41fd-9360-4ffb505712db tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:43.453182 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a4fc9d55-225f-41fd-9360-4ffb505712db tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:43.453638 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a4fc9d55-225f-41fd-9360-4ffb505712db tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:43.454064 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a4fc9d55-225f-41fd-9360-4ffb505712db tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:43.467768 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.wsgi [None req-a4fc9d55-225f-41fd-9360-4ffb505712db tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] HTTP exception thrown: Instance 6dcfb746-60d5-48b0-ab19-2d7a235860df could not be found. Sep 16 02:11:43.469287 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-a4fc9d55-225f-41fd-9360-4ffb505712db tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Request method failure captured: Sep 16 02:11:43.469287 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: request: GET /compute/v2.1/servers/6dcfb746-60d5-48b0-ab19-2d7a235860df HTTP/1.1 Sep 16 02:11:43.469287 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Accept: application/json Sep 16 02:11:43.469287 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Accept-Encoding: identity Sep 16 02:11:43.469287 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Connection: close Sep 16 02:11:43.469287 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Content-Length: 0 Sep 16 02:11:43.469287 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Content-Type: application/json Sep 16 02:11:43.469287 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Host: 10.222.0.42 Sep 16 02:11:43.469287 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Openstack-System-Scope: None Sep 16 02:11:43.469287 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: User-Agent: python-urllib3/1.26.12 Sep 16 02:11:43.469287 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Auth-Token: gAAAAABjI9mx6m5YD-VfbXTdOVSmd4NGFLNahGaBbLMo1peJ92wbDVmYwuc5RZgaFUZEqbCVEZU6kOmxNdBXGglNvRlzGtU8he2rrBc7XBc5oNHv9HVVP2iJXpOeBFUkIrXZgk5pRb1fDXNxk7RrwhUPrzMT1uDUBmKj9juzpqGuTgd9rytxkwc Sep 16 02:11:43.469287 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Domain-Id: None Sep 16 02:11:43.469287 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Domain-Name: None Sep 16 02:11:43.469287 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Identity-Status: Confirmed Sep 16 02:11:43.469287 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Is-Admin-Project: True Sep 16 02:11:43.469287 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Domain-Id: default Sep 16 02:11:43.469287 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Domain-Name: Default Sep 16 02:11:43.469287 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Id: 663bde66131d47159ffa09ad33971895 Sep 16 02:11:43.469287 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Name: tempest-AttachVolumeNegativeTest-651370638 Sep 16 02:11:43.469287 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Role: member,reader Sep 16 02:11:43.469287 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Roles: member,reader Sep 16 02:11:43.471169 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/663bde66131d47159ffa09ad33971895"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/663bde66131d47159ffa09ad33971895"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_663bde66131d47159ffa09ad33971895"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/663bde66131d47159ffa09ad33971895"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 02:11:43.471169 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant: tempest-AttachVolumeNegativeTest-651370638 Sep 16 02:11:43.471169 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant-Id: 663bde66131d47159ffa09ad33971895 Sep 16 02:11:43.471169 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-651370638 Sep 16 02:11:43.471169 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User: tempest-AttachVolumeNegativeTest-651370638-project Sep 16 02:11:43.471169 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Domain-Id: default Sep 16 02:11:43.471169 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Domain-Name: Default Sep 16 02:11:43.471169 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Id: 86bc1b5163f4453db4469fef90f27344 Sep 16 02:11:43.471169 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Name: tempest-AttachVolumeNegativeTest-651370638-project Sep 16 02:11:43.471169 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: method: > Sep 16 02:11:43.471169 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: exception: Instance 6dcfb746-60d5-48b0-ab19-2d7a235860df could not be found. Sep 16 02:11:43.471169 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: action_args: {'id': '6dcfb746-60d5-48b0-ab19-2d7a235860df'} Sep 16 02:11:43.472143 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 02:11:43.472143 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:11:43.472143 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 02:11:43.472143 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 02:11:43.472143 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 02:11:43.472143 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 02:11:43.472143 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 02:11:43.472143 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 02:11:43.472143 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 02:11:43.472143 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 02:11:43.472143 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6dcfb746-60d5-48b0-ab19-2d7a235860df could not be found. Sep 16 02:11:43.472143 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:11:43.472143 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:11:43.472143 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:11:43.472143 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:11:43.472143 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:11:43.472143 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:11:43.472143 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 02:11:43.472143 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 02:11:43.472143 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 02:11:43.473626 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 02:11:43.473626 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 02:11:43.473626 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 02:11:43.473626 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 02:11:43.473626 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 02:11:43.473626 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 02:11:43.473626 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 02:11:43.473626 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6dcfb746-60d5-48b0-ab19-2d7a235860df could not be found. Sep 16 02:11:43.473626 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:11:43.473626 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:11:43.473626 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:11:43.473626 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:11:43.473626 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:11:43.473626 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:11:43.473626 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 02:11:43.473626 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 02:11:43.473626 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6dcfb746-60d5-48b0-ab19-2d7a235860df could not be found. Sep 16 02:11:43.473626 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:11:43.475017 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-a4fc9d55-225f-41fd-9360-4ffb505712db tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Returning 404 to user: Instance 6dcfb746-60d5-48b0-ab19-2d7a235860df could not be found. {{(pid=120441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 02:11:43.475017 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-a4fc9d55-225f-41fd-9360-4ffb505712db tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/6dcfb746-60d5-48b0-ab19-2d7a235860df" status: 404 len: 111 microversion: 2.1 time: 0.029527 Sep 16 02:11:43.475017 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 560/1107] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:11:43 2022] GET /compute/v2.1/servers/6dcfb746-60d5-48b0-ab19-2d7a235860df => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 02:11:44.617372 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-ca6ca06b-c100-42df-bb9c-deadbb202be7 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:11:44.617896 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-ca6ca06b-c100-42df-bb9c-deadbb202be7 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: edc72a68-5643-42ab-8bed-d8a70c4aaeef] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:11:44.625247 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ca6ca06b-c100-42df-bb9c-deadbb202be7 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:44.625727 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ca6ca06b-c100-42df-bb9c-deadbb202be7 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:44.626160 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ca6ca06b-c100-42df-bb9c-deadbb202be7 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:44.626844 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ca6ca06b-c100-42df-bb9c-deadbb202be7 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:44.627294 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ca6ca06b-c100-42df-bb9c-deadbb202be7 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:44.627714 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ca6ca06b-c100-42df-bb9c-deadbb202be7 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:44.641032 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.wsgi [None req-ca6ca06b-c100-42df-bb9c-deadbb202be7 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] HTTP exception thrown: Instance edc72a68-5643-42ab-8bed-d8a70c4aaeef could not be found. Sep 16 02:11:44.642558 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-ca6ca06b-c100-42df-bb9c-deadbb202be7 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Request method failure captured: Sep 16 02:11:44.642558 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: request: DELETE /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef HTTP/1.1 Sep 16 02:11:44.642558 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept: application/json Sep 16 02:11:44.642558 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept-Encoding: identity Sep 16 02:11:44.642558 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Connection: close Sep 16 02:11:44.642558 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Length: 0 Sep 16 02:11:44.642558 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Type: application/json Sep 16 02:11:44.642558 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Host: 10.222.0.42 Sep 16 02:11:44.642558 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Openstack-System-Scope: None Sep 16 02:11:44.642558 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: User-Agent: python-urllib3/1.26.12 Sep 16 02:11:44.642558 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Auth-Token: gAAAAABjI9mx6m5YD-VfbXTdOVSmd4NGFLNahGaBbLMo1peJ92wbDVmYwuc5RZgaFUZEqbCVEZU6kOmxNdBXGglNvRlzGtU8he2rrBc7XBc5oNHv9HVVP2iJXpOeBFUkIrXZgk5pRb1fDXNxk7RrwhUPrzMT1uDUBmKj9juzpqGuTgd9rytxkwc Sep 16 02:11:44.642558 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Id: None Sep 16 02:11:44.642558 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Name: None Sep 16 02:11:44.642558 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Identity-Status: Confirmed Sep 16 02:11:44.642558 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Is-Admin-Project: True Sep 16 02:11:44.642558 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Id: default Sep 16 02:11:44.642558 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Name: Default Sep 16 02:11:44.642558 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Id: 663bde66131d47159ffa09ad33971895 Sep 16 02:11:44.642558 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Name: tempest-AttachVolumeNegativeTest-651370638 Sep 16 02:11:44.642558 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Role: member,reader Sep 16 02:11:44.642558 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Roles: member,reader Sep 16 02:11:44.644255 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/663bde66131d47159ffa09ad33971895"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/663bde66131d47159ffa09ad33971895"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_663bde66131d47159ffa09ad33971895"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/663bde66131d47159ffa09ad33971895"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 02:11:44.644255 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant: tempest-AttachVolumeNegativeTest-651370638 Sep 16 02:11:44.644255 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Id: 663bde66131d47159ffa09ad33971895 Sep 16 02:11:44.644255 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-651370638 Sep 16 02:11:44.644255 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User: tempest-AttachVolumeNegativeTest-651370638-project Sep 16 02:11:44.644255 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Id: default Sep 16 02:11:44.644255 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Name: Default Sep 16 02:11:44.644255 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Id: 86bc1b5163f4453db4469fef90f27344 Sep 16 02:11:44.644255 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Name: tempest-AttachVolumeNegativeTest-651370638-project Sep 16 02:11:44.644255 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: method: > Sep 16 02:11:44.644255 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: exception: Instance edc72a68-5643-42ab-8bed-d8a70c4aaeef could not be found. Sep 16 02:11:44.644255 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: action_args: {'id': 'edc72a68-5643-42ab-8bed-d8a70c4aaeef'} Sep 16 02:11:44.645142 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 02:11:44.645142 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:11:44.645142 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 02:11:44.645142 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 02:11:44.645142 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 02:11:44.645142 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 02:11:44.645142 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 02:11:44.645142 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 02:11:44.645142 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 02:11:44.645142 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 02:11:44.645142 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edc72a68-5643-42ab-8bed-d8a70c4aaeef could not be found. Sep 16 02:11:44.645142 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:11:44.645142 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:11:44.645142 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:11:44.645142 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:11:44.645142 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:11:44.645142 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:11:44.645142 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 02:11:44.645142 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 02:11:44.645142 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 02:11:44.646528 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 02:11:44.646528 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 02:11:44.646528 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 02:11:44.646528 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 02:11:44.646528 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 02:11:44.646528 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 02:11:44.646528 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 02:11:44.646528 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 02:11:44.646528 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 02:11:44.646528 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edc72a68-5643-42ab-8bed-d8a70c4aaeef could not be found. Sep 16 02:11:44.646528 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:11:44.646528 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:11:44.646528 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:11:44.646528 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:11:44.646528 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:11:44.646528 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:11:44.646528 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 02:11:44.646528 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 02:11:44.646528 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edc72a68-5643-42ab-8bed-d8a70c4aaeef could not be found. Sep 16 02:11:44.646528 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:11:44.647811 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-ca6ca06b-c100-42df-bb9c-deadbb202be7 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Returning 404 to user: Instance edc72a68-5643-42ab-8bed-d8a70c4aaeef could not be found. {{(pid=120440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 02:11:44.647811 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-ca6ca06b-c100-42df-bb9c-deadbb202be7 tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "DELETE /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef" status: 404 len: 111 microversion: 2.1 time: 0.030395 Sep 16 02:11:44.647811 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 548/1108] 10.222.0.42 () {58 vars in 1239 bytes} [Fri Sep 16 02:11:44 2022] DELETE /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 02:11:44.652133 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-ca4a717c-fe8b-4f44-a966-c445c473f19f tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:11:44.652801 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-ca4a717c-fe8b-4f44-a966-c445c473f19f tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] [instance: edc72a68-5643-42ab-8bed-d8a70c4aaeef] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:11:44.660304 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ca4a717c-fe8b-4f44-a966-c445c473f19f tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:44.660775 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ca4a717c-fe8b-4f44-a966-c445c473f19f tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:44.661204 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ca4a717c-fe8b-4f44-a966-c445c473f19f tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:44.661876 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ca4a717c-fe8b-4f44-a966-c445c473f19f tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:11:44.662321 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ca4a717c-fe8b-4f44-a966-c445c473f19f tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:11:44.662758 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ca4a717c-fe8b-4f44-a966-c445c473f19f tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:11:44.676612 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.wsgi [None req-ca4a717c-fe8b-4f44-a966-c445c473f19f tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] HTTP exception thrown: Instance edc72a68-5643-42ab-8bed-d8a70c4aaeef could not be found. Sep 16 02:11:44.678100 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-ca4a717c-fe8b-4f44-a966-c445c473f19f tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Request method failure captured: Sep 16 02:11:44.678100 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: request: GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef HTTP/1.1 Sep 16 02:11:44.678100 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Accept: application/json Sep 16 02:11:44.678100 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Accept-Encoding: identity Sep 16 02:11:44.678100 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Connection: close Sep 16 02:11:44.678100 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Content-Length: 0 Sep 16 02:11:44.678100 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Content-Type: application/json Sep 16 02:11:44.678100 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Host: 10.222.0.42 Sep 16 02:11:44.678100 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Openstack-System-Scope: None Sep 16 02:11:44.678100 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: User-Agent: python-urllib3/1.26.12 Sep 16 02:11:44.678100 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Auth-Token: gAAAAABjI9mx6m5YD-VfbXTdOVSmd4NGFLNahGaBbLMo1peJ92wbDVmYwuc5RZgaFUZEqbCVEZU6kOmxNdBXGglNvRlzGtU8he2rrBc7XBc5oNHv9HVVP2iJXpOeBFUkIrXZgk5pRb1fDXNxk7RrwhUPrzMT1uDUBmKj9juzpqGuTgd9rytxkwc Sep 16 02:11:44.678100 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Domain-Id: None Sep 16 02:11:44.678100 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Domain-Name: None Sep 16 02:11:44.678100 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Identity-Status: Confirmed Sep 16 02:11:44.678100 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Is-Admin-Project: True Sep 16 02:11:44.678100 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Domain-Id: default Sep 16 02:11:44.678100 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Domain-Name: Default Sep 16 02:11:44.678100 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Id: 663bde66131d47159ffa09ad33971895 Sep 16 02:11:44.678100 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Name: tempest-AttachVolumeNegativeTest-651370638 Sep 16 02:11:44.678100 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Role: member,reader Sep 16 02:11:44.678100 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Roles: member,reader Sep 16 02:11:44.679692 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/663bde66131d47159ffa09ad33971895"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/663bde66131d47159ffa09ad33971895"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_663bde66131d47159ffa09ad33971895"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/663bde66131d47159ffa09ad33971895"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 02:11:44.679692 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant: tempest-AttachVolumeNegativeTest-651370638 Sep 16 02:11:44.679692 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant-Id: 663bde66131d47159ffa09ad33971895 Sep 16 02:11:44.679692 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-651370638 Sep 16 02:11:44.679692 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User: tempest-AttachVolumeNegativeTest-651370638-project Sep 16 02:11:44.679692 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Domain-Id: default Sep 16 02:11:44.679692 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Domain-Name: Default Sep 16 02:11:44.679692 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Id: 86bc1b5163f4453db4469fef90f27344 Sep 16 02:11:44.679692 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Name: tempest-AttachVolumeNegativeTest-651370638-project Sep 16 02:11:44.679692 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: method: > Sep 16 02:11:44.679692 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: exception: Instance edc72a68-5643-42ab-8bed-d8a70c4aaeef could not be found. Sep 16 02:11:44.679692 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: action_args: {'id': 'edc72a68-5643-42ab-8bed-d8a70c4aaeef'} Sep 16 02:11:44.680694 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 02:11:44.680694 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:11:44.680694 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 02:11:44.680694 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 02:11:44.680694 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 02:11:44.680694 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 02:11:44.680694 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 02:11:44.680694 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 02:11:44.680694 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 02:11:44.680694 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 02:11:44.680694 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance edc72a68-5643-42ab-8bed-d8a70c4aaeef could not be found. Sep 16 02:11:44.680694 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:11:44.680694 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:11:44.680694 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:11:44.680694 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:11:44.680694 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:11:44.680694 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:11:44.680694 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 02:11:44.680694 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 02:11:44.680694 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 02:11:44.682182 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 02:11:44.682182 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 02:11:44.682182 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 02:11:44.682182 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 02:11:44.682182 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 02:11:44.682182 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 02:11:44.682182 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 02:11:44.682182 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance edc72a68-5643-42ab-8bed-d8a70c4aaeef could not be found. Sep 16 02:11:44.682182 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:11:44.682182 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:11:44.682182 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:11:44.682182 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:11:44.682182 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:11:44.682182 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:11:44.682182 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 02:11:44.682182 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 02:11:44.682182 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance edc72a68-5643-42ab-8bed-d8a70c4aaeef could not be found. Sep 16 02:11:44.682182 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:11:44.683627 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-ca4a717c-fe8b-4f44-a966-c445c473f19f tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] Returning 404 to user: Instance edc72a68-5643-42ab-8bed-d8a70c4aaeef could not be found. {{(pid=120441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 02:11:44.683627 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-ca4a717c-fe8b-4f44-a966-c445c473f19f tempest-AttachVolumeNegativeTest-651370638 tempest-AttachVolumeNegativeTest-651370638-project] 10.222.0.42 "GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef" status: 404 len: 111 microversion: 2.1 time: 0.031168 Sep 16 02:11:44.683627 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 561/1109] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:11:44 2022] GET /compute/v2.1/servers/edc72a68-5643-42ab-8bed-d8a70c4aaeef => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 02:13:38.300952 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-e497bb3b-be9c-4c1d-a39b-e33c2abb88b5 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1667237530", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1042516554", "security_groups": [{"name": "tempest-secgroup-smoke-201932569"}], "block_device_mapping_v2": [{"uuid": "ce7e0512-9f5b-4bcc-bb99-f2ba5ca3a818", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "26a960ea-9980-48fb-8180-c5983fb286de"}]}} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:13:38.331593 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR oslo.messaging._drivers.impl_rabbit [-] [b94ea62e-a008-4ed8-a218-8ff19dbcdd08] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 16 02:13:38.332477 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_api:SELECT=17 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:13:38.333385 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell1:SELECT=36,nova_cell1:INSERT=1 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:13:38.334172 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 02:13:38.334564 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Fri Sep 16 02:13:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.42) !!! Sep 16 02:13:38.336654 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 02:13:38.336947 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Fri Sep 16 02:13:38 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.42) !!! Sep 16 02:13:38.477987 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.network.neutron [None req-e497bb3b-be9c-4c1d-a39b-e33c2abb88b5 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] validate_networks() for [('26a960ea-9980-48fb-8180-c5983fb286de', None, None, None, None, None)] {{(pid=120440) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 02:13:39.010817 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.virt.hardware [None req-e497bb3b-be9c-4c1d-a39b-e33c2abb88b5 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Flavor limits 0:0:0 {{(pid=120440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 02:13:39.011504 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.virt.hardware [None req-e497bb3b-be9c-4c1d-a39b-e33c2abb88b5 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Image limits 0:0:0 {{(pid=120440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 02:13:39.012233 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.virt.hardware [None req-e497bb3b-be9c-4c1d-a39b-e33c2abb88b5 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Flavor pref 0:0:0 {{(pid=120440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 02:13:39.012743 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.virt.hardware [None req-e497bb3b-be9c-4c1d-a39b-e33c2abb88b5 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Image pref 0:0:0 {{(pid=120440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 02:13:39.013256 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.virt.hardware [None req-e497bb3b-be9c-4c1d-a39b-e33c2abb88b5 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120440) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 02:13:39.022789 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e497bb3b-be9c-4c1d-a39b-e33c2abb88b5 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:13:39.023361 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e497bb3b-be9c-4c1d-a39b-e33c2abb88b5 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:13:39.024459 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e497bb3b-be9c-4c1d-a39b-e33c2abb88b5 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:13:39.025526 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e497bb3b-be9c-4c1d-a39b-e33c2abb88b5 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:13:39.026052 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e497bb3b-be9c-4c1d-a39b-e33c2abb88b5 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:13:39.026755 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-e497bb3b-be9c-4c1d-a39b-e33c2abb88b5 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:13:39.049937 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.quota [None req-e497bb3b-be9c-4c1d-a39b-e33c2abb88b5 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Getting quotas for project 9cfcd2376b1c4398befa49b423aaae26. Resources: {'cores', 'ram', 'instances'} {{(pid=120440) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 02:13:39.054180 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.quota [None req-e497bb3b-be9c-4c1d-a39b-e33c2abb88b5 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Getting quotas for user 772659a1932d45dea2c5120c4497314b and project 9cfcd2376b1c4398befa49b423aaae26. Resources: {'cores', 'ram', 'instances'} {{(pid=120440) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 02:13:39.125822 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-e497bb3b-be9c-4c1d-a39b-e33c2abb88b5 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Going to run 1 instances... {{(pid=120440) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 02:13:39.128474 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-e497bb3b-be9c-4c1d-a39b-e33c2abb88b5 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: ff79691f-7595-4bec-92bd-4a636d9d9de0] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='ce7e0512-9f5b-4bcc-bb99-f2ba5ca3a818',volume_size=None,volume_type=None)] {{(pid=120440) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 02:13:39.293947 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-e497bb3b-be9c-4c1d-a39b-e33c2abb88b5 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.001001 Sep 16 02:13:39.294595 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 549/1110] 10.222.0.42 () {60 vars in 1147 bytes} [Fri Sep 16 02:13:38 2022] POST /compute/v2.1/servers => generated 405 bytes in 1002 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 02:13:39.303917 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_api:SELECT=23,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:13:39.304798 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell1:SELECT=35,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:13:39.306198 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 02:13:39.306391 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Fri Sep 16 02:13:39 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/ff79691f-7595-4bec-92bd-4a636d9d9de0 (ip 10.222.0.42) !!! Sep 16 02:13:39.313369 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-7b4beb1a-0bf2-4c62-b199-2deb8e4e62dd tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:13:39.314205 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-7b4beb1a-0bf2-4c62-b199-2deb8e4e62dd tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: ff79691f-7595-4bec-92bd-4a636d9d9de0] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:13:39.394465 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-7b4beb1a-0bf2-4c62-b199-2deb8e4e62dd tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:13:39.401970 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-7b4beb1a-0bf2-4c62-b199-2deb8e4e62dd tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/ff79691f-7595-4bec-92bd-4a636d9d9de0" status: 200 len: 1095 microversion: 2.1 time: 0.099961 Sep 16 02:13:39.402796 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 562/1111] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:13:39 2022] GET /compute/v2.1/servers/ff79691f-7595-4bec-92bd-4a636d9d9de0 => generated 1095 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:13:40.424231 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-ebfd7963-16ac-48c8-a694-9b139562577e tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:13:40.424777 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-ebfd7963-16ac-48c8-a694-9b139562577e tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: ff79691f-7595-4bec-92bd-4a636d9d9de0] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:13:40.433637 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ebfd7963-16ac-48c8-a694-9b139562577e tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:13:40.434134 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ebfd7963-16ac-48c8-a694-9b139562577e tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:13:40.434605 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ebfd7963-16ac-48c8-a694-9b139562577e tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:13:40.435827 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ebfd7963-16ac-48c8-a694-9b139562577e tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:13:40.436312 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ebfd7963-16ac-48c8-a694-9b139562577e tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:13:40.436947 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ebfd7963-16ac-48c8-a694-9b139562577e tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:13:40.459595 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO oslo.messaging._drivers.impl_rabbit [-] [b94ea62e-a008-4ed8-a218-8ff19dbcdd08] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 40072. Sep 16 02:13:40.527214 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-ebfd7963-16ac-48c8-a694-9b139562577e tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:13:40.535526 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-ebfd7963-16ac-48c8-a694-9b139562577e tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/ff79691f-7595-4bec-92bd-4a636d9d9de0" status: 200 len: 1193 microversion: 2.1 time: 0.115292 Sep 16 02:13:40.536363 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 550/1112] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:13:40 2022] GET /compute/v2.1/servers/ff79691f-7595-4bec-92bd-4a636d9d9de0 => generated 1193 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:13:41.561063 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-0815d0fc-cfac-4800-b723-f81d158e1b2f tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:13:41.561601 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-0815d0fc-cfac-4800-b723-f81d158e1b2f tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: ff79691f-7595-4bec-92bd-4a636d9d9de0] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:13:41.574248 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0815d0fc-cfac-4800-b723-f81d158e1b2f tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:13:41.580384 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0815d0fc-cfac-4800-b723-f81d158e1b2f tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:13:41.581201 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0815d0fc-cfac-4800-b723-f81d158e1b2f tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:13:41.584424 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0815d0fc-cfac-4800-b723-f81d158e1b2f tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:13:41.585680 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0815d0fc-cfac-4800-b723-f81d158e1b2f tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:13:41.586878 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0815d0fc-cfac-4800-b723-f81d158e1b2f tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:13:42.232140 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-0815d0fc-cfac-4800-b723-f81d158e1b2f tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:13:42.246782 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-0815d0fc-cfac-4800-b723-f81d158e1b2f tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/ff79691f-7595-4bec-92bd-4a636d9d9de0" status: 200 len: 1278 microversion: 2.1 time: 0.689588 Sep 16 02:13:42.248996 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 563/1113] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:13:41 2022] GET /compute/v2.1/servers/ff79691f-7595-4bec-92bd-4a636d9d9de0 => generated 1278 bytes in 695 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:13:43.275771 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-eb9c2106-384c-4af4-9028-4a75f715f863 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:13:43.276423 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-eb9c2106-384c-4af4-9028-4a75f715f863 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: ff79691f-7595-4bec-92bd-4a636d9d9de0] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:13:43.289580 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-eb9c2106-384c-4af4-9028-4a75f715f863 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:13:43.290356 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-eb9c2106-384c-4af4-9028-4a75f715f863 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:13:43.290882 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-eb9c2106-384c-4af4-9028-4a75f715f863 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:13:43.291704 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-eb9c2106-384c-4af4-9028-4a75f715f863 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:13:43.292196 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-eb9c2106-384c-4af4-9028-4a75f715f863 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:13:43.293816 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-eb9c2106-384c-4af4-9028-4a75f715f863 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:13:43.336910 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [req-a966d4d6-7e07-4b71-97f5-f73892cd855b req-7329a4aa-f4a6-452a-ac8a-becae8b773c1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff79691f-7595-4bec-92bd-4a636d9d9de0", "tag": "cd5e9a80-fe4d-44cf-94e7-64bafb6d27b1"}]} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:13:43.392494 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-a966d4d6-7e07-4b71-97f5-f73892cd855b req-7329a4aa-f4a6-452a-ac8a-becae8b773c1 service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:13:43.393159 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-a966d4d6-7e07-4b71-97f5-f73892cd855b req-7329a4aa-f4a6-452a-ac8a-becae8b773c1 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:13:43.393575 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-a966d4d6-7e07-4b71-97f5-f73892cd855b req-7329a4aa-f4a6-452a-ac8a-becae8b773c1 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:13:43.428564 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.compute.server_external_events [req-a966d4d6-7e07-4b71-97f5-f73892cd855b req-7329a4aa-f4a6-452a-ac8a-becae8b773c1 service nova] Creating event network-changed:cd5e9a80-fe4d-44cf-94e7-64bafb6d27b1 for instance ff79691f-7595-4bec-92bd-4a636d9d9de0 on hv-cinder-84914 Sep 16 02:13:43.435432 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [req-a966d4d6-7e07-4b71-97f5-f73892cd855b req-7329a4aa-f4a6-452a-ac8a-becae8b773c1 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.103286 Sep 16 02:13:43.436396 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 564/1114] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:13:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:13:43.949902 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-eb9c2106-384c-4af4-9028-4a75f715f863 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:13:43.973949 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-eb9c2106-384c-4af4-9028-4a75f715f863 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/ff79691f-7595-4bec-92bd-4a636d9d9de0" status: 200 len: 1266 microversion: 2.1 time: 0.702276 Sep 16 02:13:43.988420 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 551/1115] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:13:43 2022] GET /compute/v2.1/servers/ff79691f-7595-4bec-92bd-4a636d9d9de0 => generated 1266 bytes in 718 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:13:45.011013 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-6c550021-1ac9-4a1c-8e63-1de8a37365ea tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:13:45.011665 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-6c550021-1ac9-4a1c-8e63-1de8a37365ea tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: ff79691f-7595-4bec-92bd-4a636d9d9de0] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:13:45.021665 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6c550021-1ac9-4a1c-8e63-1de8a37365ea tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:13:45.024292 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6c550021-1ac9-4a1c-8e63-1de8a37365ea tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:13:45.028038 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6c550021-1ac9-4a1c-8e63-1de8a37365ea tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:13:45.029595 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6c550021-1ac9-4a1c-8e63-1de8a37365ea tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:13:45.030512 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6c550021-1ac9-4a1c-8e63-1de8a37365ea tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:13:45.031111 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6c550021-1ac9-4a1c-8e63-1de8a37365ea tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:13:45.207676 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-6c550021-1ac9-4a1c-8e63-1de8a37365ea tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:13:45.218537 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-6c550021-1ac9-4a1c-8e63-1de8a37365ea tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/ff79691f-7595-4bec-92bd-4a636d9d9de0" status: 200 len: 1266 microversion: 2.1 time: 0.211526 Sep 16 02:13:45.219680 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 552/1116] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:13:45 2022] GET /compute/v2.1/servers/ff79691f-7595-4bec-92bd-4a636d9d9de0 => generated 1266 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:13:45.221979 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-8f168a5c-040f-4d6b-b71d-4c1c04f559f3 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Action: 'create', calling method: .version_select at 0x7fae36371c10>, body: {"keypair": {"name": "tempest-TestShelveInstance-103467745", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKn5ildml2ATxTPquPUo+dK8nwNzQK7tcW86Bh6vgE1yPsVPYW1gI5IEwsALO1q+FV2ydjHOx1zZWop6Px+tQi6813jRb2KbXh7t7ucVCsxft281UatZAhxKxngs0z/gTw=="}} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:13:45.241672 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.quota [None req-8f168a5c-040f-4d6b-b71d-4c1c04f559f3 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Getting quotas for project f1bf0e348b4944e8907b80446a12a6ac. Resources: {'key_pairs'} {{(pid=120441) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 02:13:45.247433 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.quota [None req-8f168a5c-040f-4d6b-b71d-4c1c04f559f3 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Getting quotas for user c3333a4ba4204c80ac03c960bfb77ee3 and project f1bf0e348b4944e8907b80446a12a6ac. Resources: {'key_pairs'} {{(pid=120441) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 02:13:45.271749 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-8f168a5c-040f-4d6b-b71d-4c1c04f559f3 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] 10.222.0.42 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.334775 Sep 16 02:13:45.272475 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 565/1117] 10.222.0.42 () {60 vars in 1159 bytes} [Fri Sep 16 02:13:44 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:13:46.246417 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-900436a8-1524-4999-998d-50ac2a4158d1 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:13:46.248252 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-900436a8-1524-4999-998d-50ac2a4158d1 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: ff79691f-7595-4bec-92bd-4a636d9d9de0] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:13:46.256499 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-900436a8-1524-4999-998d-50ac2a4158d1 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:13:46.257514 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-900436a8-1524-4999-998d-50ac2a4158d1 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:13:46.259085 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-900436a8-1524-4999-998d-50ac2a4158d1 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:13:46.265107 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-900436a8-1524-4999-998d-50ac2a4158d1 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:13:46.265699 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-900436a8-1524-4999-998d-50ac2a4158d1 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:13:46.266917 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-900436a8-1524-4999-998d-50ac2a4158d1 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:13:46.425923 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-900436a8-1524-4999-998d-50ac2a4158d1 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:13:46.433990 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-900436a8-1524-4999-998d-50ac2a4158d1 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/ff79691f-7595-4bec-92bd-4a636d9d9de0" status: 200 len: 1266 microversion: 2.1 time: 0.192648 Sep 16 02:13:46.434645 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 553/1118] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:13:46 2022] GET /compute/v2.1/servers/ff79691f-7595-4bec-92bd-4a636d9d9de0 => generated 1266 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:13:47.457280 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-3b87d856-49e2-40e7-920c-5cd57f12f2ba tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:13:47.458065 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-3b87d856-49e2-40e7-920c-5cd57f12f2ba tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: ff79691f-7595-4bec-92bd-4a636d9d9de0] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:13:47.467477 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3b87d856-49e2-40e7-920c-5cd57f12f2ba tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:13:47.467979 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3b87d856-49e2-40e7-920c-5cd57f12f2ba tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:13:47.468427 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3b87d856-49e2-40e7-920c-5cd57f12f2ba tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:13:47.469137 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3b87d856-49e2-40e7-920c-5cd57f12f2ba tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:13:47.469595 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3b87d856-49e2-40e7-920c-5cd57f12f2ba tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:13:47.470054 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-3b87d856-49e2-40e7-920c-5cd57f12f2ba tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:13:47.612518 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-3b87d856-49e2-40e7-920c-5cd57f12f2ba tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:13:47.621367 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-3b87d856-49e2-40e7-920c-5cd57f12f2ba tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/ff79691f-7595-4bec-92bd-4a636d9d9de0" status: 200 len: 1266 microversion: 2.1 time: 0.168178 Sep 16 02:13:47.621950 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 566/1119] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:13:47 2022] GET /compute/v2.1/servers/ff79691f-7595-4bec-92bd-4a636d9d9de0 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:13:48.644248 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-f1fd6b0c-1e67-4c0d-a703-826c4b6ecc9c tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:13:48.644863 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-f1fd6b0c-1e67-4c0d-a703-826c4b6ecc9c tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: ff79691f-7595-4bec-92bd-4a636d9d9de0] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:13:48.651410 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f1fd6b0c-1e67-4c0d-a703-826c4b6ecc9c tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:13:48.651893 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f1fd6b0c-1e67-4c0d-a703-826c4b6ecc9c tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:13:48.652382 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f1fd6b0c-1e67-4c0d-a703-826c4b6ecc9c tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:13:48.653079 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f1fd6b0c-1e67-4c0d-a703-826c4b6ecc9c tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:13:48.653537 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f1fd6b0c-1e67-4c0d-a703-826c4b6ecc9c tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:13:48.653970 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f1fd6b0c-1e67-4c0d-a703-826c4b6ecc9c tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:13:48.790274 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-f1fd6b0c-1e67-4c0d-a703-826c4b6ecc9c tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:13:48.798184 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-f1fd6b0c-1e67-4c0d-a703-826c4b6ecc9c tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/ff79691f-7595-4bec-92bd-4a636d9d9de0" status: 200 len: 1266 microversion: 2.1 time: 0.158023 Sep 16 02:13:48.798754 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 554/1120] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:13:48 2022] GET /compute/v2.1/servers/ff79691f-7595-4bec-92bd-4a636d9d9de0 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:13:49.821487 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-1ff0c0c6-7e34-4896-b2ba-82e82ea8237d tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:13:49.822102 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-1ff0c0c6-7e34-4896-b2ba-82e82ea8237d tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: ff79691f-7595-4bec-92bd-4a636d9d9de0] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:13:49.828626 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1ff0c0c6-7e34-4896-b2ba-82e82ea8237d tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:13:49.829110 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1ff0c0c6-7e34-4896-b2ba-82e82ea8237d tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:13:49.829546 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1ff0c0c6-7e34-4896-b2ba-82e82ea8237d tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:13:49.830229 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1ff0c0c6-7e34-4896-b2ba-82e82ea8237d tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:13:49.830683 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1ff0c0c6-7e34-4896-b2ba-82e82ea8237d tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:13:49.831106 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1ff0c0c6-7e34-4896-b2ba-82e82ea8237d tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:13:49.971152 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-1ff0c0c6-7e34-4896-b2ba-82e82ea8237d tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:13:49.978966 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-1ff0c0c6-7e34-4896-b2ba-82e82ea8237d tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/ff79691f-7595-4bec-92bd-4a636d9d9de0" status: 200 len: 1266 microversion: 2.1 time: 0.162020 Sep 16 02:13:49.979518 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 567/1121] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:13:49 2022] GET /compute/v2.1/servers/ff79691f-7595-4bec-92bd-4a636d9d9de0 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:13:51.002712 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-b3839a62-ac5e-4838-bd50-a35ff25dfd94 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:13:51.003321 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-b3839a62-ac5e-4838-bd50-a35ff25dfd94 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: ff79691f-7595-4bec-92bd-4a636d9d9de0] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:13:51.005153 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell0:SELECT=2 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:13:51.005834 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell0:SELECT=6 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:13:51.012906 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b3839a62-ac5e-4838-bd50-a35ff25dfd94 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:13:51.013391 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b3839a62-ac5e-4838-bd50-a35ff25dfd94 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:13:51.013829 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b3839a62-ac5e-4838-bd50-a35ff25dfd94 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:13:51.014517 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b3839a62-ac5e-4838-bd50-a35ff25dfd94 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:13:51.014973 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b3839a62-ac5e-4838-bd50-a35ff25dfd94 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:13:51.015401 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b3839a62-ac5e-4838-bd50-a35ff25dfd94 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:13:51.152132 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-b3839a62-ac5e-4838-bd50-a35ff25dfd94 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:13:51.159685 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-b3839a62-ac5e-4838-bd50-a35ff25dfd94 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/ff79691f-7595-4bec-92bd-4a636d9d9de0" status: 200 len: 1266 microversion: 2.1 time: 0.160858 Sep 16 02:13:51.160295 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 555/1122] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:13:50 2022] GET /compute/v2.1/servers/ff79691f-7595-4bec-92bd-4a636d9d9de0 => generated 1266 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:13:52.183674 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-77aff9bf-8731-4bb5-b3bb-8e974632d4bf tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:13:52.184398 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-77aff9bf-8731-4bb5-b3bb-8e974632d4bf tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: ff79691f-7595-4bec-92bd-4a636d9d9de0] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:13:52.190267 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-77aff9bf-8731-4bb5-b3bb-8e974632d4bf tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:13:52.190743 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-77aff9bf-8731-4bb5-b3bb-8e974632d4bf tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:13:52.191167 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-77aff9bf-8731-4bb5-b3bb-8e974632d4bf tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:13:52.191851 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-77aff9bf-8731-4bb5-b3bb-8e974632d4bf tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:13:52.192327 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-77aff9bf-8731-4bb5-b3bb-8e974632d4bf tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:13:52.192746 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-77aff9bf-8731-4bb5-b3bb-8e974632d4bf tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:13:52.323848 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-77aff9bf-8731-4bb5-b3bb-8e974632d4bf tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:13:52.331422 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-77aff9bf-8731-4bb5-b3bb-8e974632d4bf tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/ff79691f-7595-4bec-92bd-4a636d9d9de0" status: 200 len: 1266 microversion: 2.1 time: 0.152621 Sep 16 02:13:52.332004 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 568/1123] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:13:52 2022] GET /compute/v2.1/servers/ff79691f-7595-4bec-92bd-4a636d9d9de0 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:13:53.355076 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-7a5f6c15-8dd6-4071-b372-2db256988aa1 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:13:53.355686 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-7a5f6c15-8dd6-4071-b372-2db256988aa1 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: ff79691f-7595-4bec-92bd-4a636d9d9de0] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:13:53.362253 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7a5f6c15-8dd6-4071-b372-2db256988aa1 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:13:53.362731 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7a5f6c15-8dd6-4071-b372-2db256988aa1 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:13:53.363314 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7a5f6c15-8dd6-4071-b372-2db256988aa1 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:13:53.364042 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7a5f6c15-8dd6-4071-b372-2db256988aa1 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:13:53.364775 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7a5f6c15-8dd6-4071-b372-2db256988aa1 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:13:53.365203 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7a5f6c15-8dd6-4071-b372-2db256988aa1 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:13:53.509732 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-7a5f6c15-8dd6-4071-b372-2db256988aa1 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:13:53.517636 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-7a5f6c15-8dd6-4071-b372-2db256988aa1 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/ff79691f-7595-4bec-92bd-4a636d9d9de0" status: 200 len: 1266 microversion: 2.1 time: 0.166783 Sep 16 02:13:53.518222 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 556/1124] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:13:53 2022] GET /compute/v2.1/servers/ff79691f-7595-4bec-92bd-4a636d9d9de0 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:13:54.541457 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-f06be046-fe12-4d29-a2c1-fdfc2428342e tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:13:54.542074 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-f06be046-fe12-4d29-a2c1-fdfc2428342e tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: ff79691f-7595-4bec-92bd-4a636d9d9de0] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:13:54.548979 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f06be046-fe12-4d29-a2c1-fdfc2428342e tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:13:54.549467 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f06be046-fe12-4d29-a2c1-fdfc2428342e tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:13:54.549903 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f06be046-fe12-4d29-a2c1-fdfc2428342e tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:13:54.550602 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f06be046-fe12-4d29-a2c1-fdfc2428342e tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:13:54.551056 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f06be046-fe12-4d29-a2c1-fdfc2428342e tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:13:54.551481 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f06be046-fe12-4d29-a2c1-fdfc2428342e tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:13:54.683184 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-f06be046-fe12-4d29-a2c1-fdfc2428342e tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:13:54.691153 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-f06be046-fe12-4d29-a2c1-fdfc2428342e tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/ff79691f-7595-4bec-92bd-4a636d9d9de0" status: 200 len: 1266 microversion: 2.1 time: 0.154023 Sep 16 02:13:54.691737 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 569/1125] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:13:54 2022] GET /compute/v2.1/servers/ff79691f-7595-4bec-92bd-4a636d9d9de0 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:13:55.715598 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-20c589a7-2c23-4dbc-a61a-0b71fe38f023 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:13:55.716165 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-20c589a7-2c23-4dbc-a61a-0b71fe38f023 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: ff79691f-7595-4bec-92bd-4a636d9d9de0] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:13:55.722443 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-20c589a7-2c23-4dbc-a61a-0b71fe38f023 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:13:55.722911 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-20c589a7-2c23-4dbc-a61a-0b71fe38f023 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:13:55.723338 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-20c589a7-2c23-4dbc-a61a-0b71fe38f023 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:13:55.724048 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-20c589a7-2c23-4dbc-a61a-0b71fe38f023 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:13:55.724495 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-20c589a7-2c23-4dbc-a61a-0b71fe38f023 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:13:55.724910 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-20c589a7-2c23-4dbc-a61a-0b71fe38f023 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:13:55.860181 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-20c589a7-2c23-4dbc-a61a-0b71fe38f023 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:13:55.868179 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-20c589a7-2c23-4dbc-a61a-0b71fe38f023 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/ff79691f-7595-4bec-92bd-4a636d9d9de0" status: 200 len: 1266 microversion: 2.1 time: 0.157119 Sep 16 02:13:55.868448 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 557/1126] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:13:55 2022] GET /compute/v2.1/servers/ff79691f-7595-4bec-92bd-4a636d9d9de0 => generated 1266 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:13:56.551840 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [req-99485f05-3065-43ef-837d-24d93cdace03 req-3b444b0f-717b-4ff3-83b4-d463de877046 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff79691f-7595-4bec-92bd-4a636d9d9de0", "name": "network-vif-plugged", "status": "completed", "tag": "cd5e9a80-fe4d-44cf-94e7-64bafb6d27b1"}]} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:13:56.557466 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell0:SELECT=6 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:13:56.563630 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-99485f05-3065-43ef-837d-24d93cdace03 req-3b444b0f-717b-4ff3-83b4-d463de877046 service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:13:56.566857 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-99485f05-3065-43ef-837d-24d93cdace03 req-3b444b0f-717b-4ff3-83b4-d463de877046 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:13:56.566857 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-99485f05-3065-43ef-837d-24d93cdace03 req-3b444b0f-717b-4ff3-83b4-d463de877046 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:13:56.576331 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.compute.server_external_events [req-99485f05-3065-43ef-837d-24d93cdace03 req-3b444b0f-717b-4ff3-83b4-d463de877046 service nova] Creating event network-vif-plugged:cd5e9a80-fe4d-44cf-94e7-64bafb6d27b1 for instance ff79691f-7595-4bec-92bd-4a636d9d9de0 on hv-cinder-84914 Sep 16 02:13:56.581353 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [req-99485f05-3065-43ef-837d-24d93cdace03 req-3b444b0f-717b-4ff3-83b4-d463de877046 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033254 Sep 16 02:13:56.582129 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 570/1127] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:13:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:13:56.890531 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-3695d537-e834-4104-bfd6-3e7e44394388 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:13:56.891155 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-3695d537-e834-4104-bfd6-3e7e44394388 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: ff79691f-7595-4bec-92bd-4a636d9d9de0] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:13:56.897647 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3695d537-e834-4104-bfd6-3e7e44394388 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:13:56.898017 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3695d537-e834-4104-bfd6-3e7e44394388 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:13:56.898752 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3695d537-e834-4104-bfd6-3e7e44394388 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:13:56.899407 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3695d537-e834-4104-bfd6-3e7e44394388 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:13:56.899864 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3695d537-e834-4104-bfd6-3e7e44394388 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:13:56.900343 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3695d537-e834-4104-bfd6-3e7e44394388 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:13:57.033255 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-3695d537-e834-4104-bfd6-3e7e44394388 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:13:57.040843 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-3695d537-e834-4104-bfd6-3e7e44394388 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/ff79691f-7595-4bec-92bd-4a636d9d9de0" status: 200 len: 1266 microversion: 2.1 time: 0.154619 Sep 16 02:13:57.041459 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 558/1128] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:13:56 2022] GET /compute/v2.1/servers/ff79691f-7595-4bec-92bd-4a636d9d9de0 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:13:58.065003 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-55ab73f7-8999-4125-b591-3d608c7a2b19 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:13:58.065651 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-55ab73f7-8999-4125-b591-3d608c7a2b19 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: ff79691f-7595-4bec-92bd-4a636d9d9de0] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:13:58.071687 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-55ab73f7-8999-4125-b591-3d608c7a2b19 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:13:58.072204 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-55ab73f7-8999-4125-b591-3d608c7a2b19 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:13:58.072718 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-55ab73f7-8999-4125-b591-3d608c7a2b19 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:13:58.073590 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-55ab73f7-8999-4125-b591-3d608c7a2b19 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:13:58.074051 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-55ab73f7-8999-4125-b591-3d608c7a2b19 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:13:58.074480 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-55ab73f7-8999-4125-b591-3d608c7a2b19 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:13:58.214651 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-55ab73f7-8999-4125-b591-3d608c7a2b19 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:13:58.222438 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-55ab73f7-8999-4125-b591-3d608c7a2b19 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/ff79691f-7595-4bec-92bd-4a636d9d9de0" status: 200 len: 1266 microversion: 2.1 time: 0.162197 Sep 16 02:13:58.223013 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 571/1129] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:13:58 2022] GET /compute/v2.1/servers/ff79691f-7595-4bec-92bd-4a636d9d9de0 => generated 1266 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:13:59.246483 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-151c6315-a7b5-4393-a61f-61488d587d70 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:13:59.247082 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-151c6315-a7b5-4393-a61f-61488d587d70 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: ff79691f-7595-4bec-92bd-4a636d9d9de0] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:13:59.253489 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-151c6315-a7b5-4393-a61f-61488d587d70 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:13:59.253974 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-151c6315-a7b5-4393-a61f-61488d587d70 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:13:59.254412 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-151c6315-a7b5-4393-a61f-61488d587d70 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:13:59.255103 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-151c6315-a7b5-4393-a61f-61488d587d70 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:13:59.255560 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-151c6315-a7b5-4393-a61f-61488d587d70 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:13:59.256017 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-151c6315-a7b5-4393-a61f-61488d587d70 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:13:59.387753 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-151c6315-a7b5-4393-a61f-61488d587d70 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:13:59.395590 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-151c6315-a7b5-4393-a61f-61488d587d70 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/ff79691f-7595-4bec-92bd-4a636d9d9de0" status: 200 len: 1452 microversion: 2.1 time: 0.153923 Sep 16 02:13:59.396246 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 559/1130] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:13:59 2022] GET /compute/v2.1/servers/ff79691f-7595-4bec-92bd-4a636d9d9de0 => generated 1452 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:13:59.418207 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-f4a4b603-ea9d-4e04-a921-6b2662786266 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:13:59.418737 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-f4a4b603-ea9d-4e04-a921-6b2662786266 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: ff79691f-7595-4bec-92bd-4a636d9d9de0] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:13:59.424974 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f4a4b603-ea9d-4e04-a921-6b2662786266 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:13:59.425466 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f4a4b603-ea9d-4e04-a921-6b2662786266 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:13:59.425906 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f4a4b603-ea9d-4e04-a921-6b2662786266 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:13:59.426600 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f4a4b603-ea9d-4e04-a921-6b2662786266 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:13:59.427091 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f4a4b603-ea9d-4e04-a921-6b2662786266 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:13:59.427518 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f4a4b603-ea9d-4e04-a921-6b2662786266 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:13:59.566692 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-f4a4b603-ea9d-4e04-a921-6b2662786266 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:13:59.575390 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-f4a4b603-ea9d-4e04-a921-6b2662786266 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/ff79691f-7595-4bec-92bd-4a636d9d9de0" status: 200 len: 1452 microversion: 2.1 time: 0.161862 Sep 16 02:13:59.576199 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 572/1131] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:13:59 2022] GET /compute/v2.1/servers/ff79691f-7595-4bec-92bd-4a636d9d9de0 => generated 1452 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:14:01.278253 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [req-5d7875c7-5fcc-4169-a7df-36535aa989a0 req-af569f9d-3660-4793-bacc-66c5f4e4582c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff79691f-7595-4bec-92bd-4a636d9d9de0", "tag": "cd5e9a80-fe4d-44cf-94e7-64bafb6d27b1"}]} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:14:01.288154 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-5d7875c7-5fcc-4169-a7df-36535aa989a0 req-af569f9d-3660-4793-bacc-66c5f4e4582c service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:14:01.288636 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-5d7875c7-5fcc-4169-a7df-36535aa989a0 req-af569f9d-3660-4793-bacc-66c5f4e4582c service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:14:01.289066 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-5d7875c7-5fcc-4169-a7df-36535aa989a0 req-af569f9d-3660-4793-bacc-66c5f4e4582c service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:14:01.300736 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.compute.server_external_events [req-5d7875c7-5fcc-4169-a7df-36535aa989a0 req-af569f9d-3660-4793-bacc-66c5f4e4582c service nova] Creating event network-changed:cd5e9a80-fe4d-44cf-94e7-64bafb6d27b1 for instance ff79691f-7595-4bec-92bd-4a636d9d9de0 on hv-cinder-84914 Sep 16 02:14:01.305834 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [req-5d7875c7-5fcc-4169-a7df-36535aa989a0 req-af569f9d-3660-4793-bacc-66c5f4e4582c service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031488 Sep 16 02:14:01.306423 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 560/1132] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:14:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:14:08.941001 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-0bbc73bc-d302-4cec-a428-9504a22e5051 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-994256018", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-103467745", "security_groups": [{"name": "tempest-secgroup-smoke-180323317"}], "networks": [{"uuid": "31bd9b2e-65b9-4f38-9e36-5d5570da2439"}], "block_device_mapping_v2": [{"uuid": "e70e2494-594e-472e-ba66-4d24f621507c", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:14:09.060394 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.network.neutron [None req-0bbc73bc-d302-4cec-a428-9504a22e5051 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] validate_networks() for [('31bd9b2e-65b9-4f38-9e36-5d5570da2439', None, None, None, None, None)] {{(pid=120441) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 02:14:09.570824 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell1:SELECT=46 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:14:09.727522 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.virt.hardware [None req-0bbc73bc-d302-4cec-a428-9504a22e5051 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Flavor limits 0:0:0 {{(pid=120441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 02:14:09.728604 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.virt.hardware [None req-0bbc73bc-d302-4cec-a428-9504a22e5051 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Image limits 0:0:0 {{(pid=120441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 02:14:09.729274 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.virt.hardware [None req-0bbc73bc-d302-4cec-a428-9504a22e5051 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Flavor pref 0:0:0 {{(pid=120441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 02:14:09.729747 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.virt.hardware [None req-0bbc73bc-d302-4cec-a428-9504a22e5051 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Image pref 0:0:0 {{(pid=120441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 02:14:09.730158 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.virt.hardware [None req-0bbc73bc-d302-4cec-a428-9504a22e5051 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=120441) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 02:14:09.732070 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=1 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:14:09.741886 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0bbc73bc-d302-4cec-a428-9504a22e5051 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:14:09.742366 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0bbc73bc-d302-4cec-a428-9504a22e5051 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:14:09.742797 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0bbc73bc-d302-4cec-a428-9504a22e5051 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:14:09.743518 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0bbc73bc-d302-4cec-a428-9504a22e5051 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:14:09.744059 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0bbc73bc-d302-4cec-a428-9504a22e5051 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:14:09.744575 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-0bbc73bc-d302-4cec-a428-9504a22e5051 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:14:09.761592 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.quota [None req-0bbc73bc-d302-4cec-a428-9504a22e5051 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Getting quotas for project f1bf0e348b4944e8907b80446a12a6ac. Resources: {'cores', 'ram', 'instances'} {{(pid=120441) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 02:14:09.765498 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.quota [None req-0bbc73bc-d302-4cec-a428-9504a22e5051 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Getting quotas for user c3333a4ba4204c80ac03c960bfb77ee3 and project f1bf0e348b4944e8907b80446a12a6ac. Resources: {'cores', 'ram', 'instances'} {{(pid=120441) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 02:14:09.822708 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-0bbc73bc-d302-4cec-a428-9504a22e5051 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Going to run 1 instances... {{(pid=120441) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 02:14:09.824976 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-0bbc73bc-d302-4cec-a428-9504a22e5051 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] [instance: 4dc692c5-9b00-4551-a5f5-43277c08ba98] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='e70e2494-594e-472e-ba66-4d24f621507c',volume_size=None,volume_type=None)] {{(pid=120441) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 02:14:09.953536 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-0bbc73bc-d302-4cec-a428-9504a22e5051 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] 10.222.0.42 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 1.016395 Sep 16 02:14:09.954346 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 573/1133] 10.222.0.42 () {60 vars in 1147 bytes} [Fri Sep 16 02:14:08 2022] POST /compute/v2.1/servers => generated 405 bytes in 1018 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 02:14:09.966486 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-abef8d28-8d14-4cdd-b554-d3b339a3263f tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:14:09.967180 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-abef8d28-8d14-4cdd-b554-d3b339a3263f tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] [instance: 4dc692c5-9b00-4551-a5f5-43277c08ba98] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:14:09.969114 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_api:SELECT=38,nova_api:INSERT=3 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:14:10.023057 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-abef8d28-8d14-4cdd-b554-d3b339a3263f tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3333a4ba4204c80ac03c960bfb77ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bf0e348b4944e8907b80446a12a6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:14:10.030026 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-abef8d28-8d14-4cdd-b554-d3b339a3263f tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] 10.222.0.42 "GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98" status: 200 len: 1087 microversion: 2.1 time: 0.068485 Sep 16 02:14:10.030594 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 561/1134] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:14:09 2022] GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98 => generated 1087 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:14:11.054712 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-400b72f9-f4ae-4487-b237-9596e2455424 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:14:11.055353 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-400b72f9-f4ae-4487-b237-9596e2455424 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] [instance: 4dc692c5-9b00-4551-a5f5-43277c08ba98] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:14:11.109689 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-400b72f9-f4ae-4487-b237-9596e2455424 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3333a4ba4204c80ac03c960bfb77ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bf0e348b4944e8907b80446a12a6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:14:11.116979 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-400b72f9-f4ae-4487-b237-9596e2455424 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] 10.222.0.42 "GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98" status: 200 len: 1087 microversion: 2.1 time: 0.067329 Sep 16 02:14:11.117626 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 574/1135] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:14:11 2022] GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98 => generated 1087 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:14:12.140417 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-f08dfe91-0e35-45c8-8ded-acfe0859668e tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:14:12.141029 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-f08dfe91-0e35-45c8-8ded-acfe0859668e tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] [instance: 4dc692c5-9b00-4551-a5f5-43277c08ba98] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:14:12.143005 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell1:SELECT=64 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:14:12.197985 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-f08dfe91-0e35-45c8-8ded-acfe0859668e tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3333a4ba4204c80ac03c960bfb77ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bf0e348b4944e8907b80446a12a6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:14:12.205499 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-f08dfe91-0e35-45c8-8ded-acfe0859668e tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] 10.222.0.42 "GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98" status: 200 len: 1087 microversion: 2.1 time: 0.068942 Sep 16 02:14:12.206055 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 562/1136] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:14:12 2022] GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98 => generated 1087 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:14:13.229899 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-e387e19e-4943-4a06-aee7-20772101d8f1 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:14:13.230505 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-e387e19e-4943-4a06-aee7-20772101d8f1 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] [instance: 4dc692c5-9b00-4551-a5f5-43277c08ba98] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:14:13.236800 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e387e19e-4943-4a06-aee7-20772101d8f1 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:14:13.237271 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e387e19e-4943-4a06-aee7-20772101d8f1 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:14:13.237697 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e387e19e-4943-4a06-aee7-20772101d8f1 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:14:13.238365 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e387e19e-4943-4a06-aee7-20772101d8f1 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:14:13.238809 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e387e19e-4943-4a06-aee7-20772101d8f1 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:14:13.239225 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e387e19e-4943-4a06-aee7-20772101d8f1 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:14:13.302819 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-e387e19e-4943-4a06-aee7-20772101d8f1 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3333a4ba4204c80ac03c960bfb77ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bf0e348b4944e8907b80446a12a6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:14:13.310649 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-e387e19e-4943-4a06-aee7-20772101d8f1 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] 10.222.0.42 "GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98" status: 200 len: 1137 microversion: 2.1 time: 0.085683 Sep 16 02:14:13.311208 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 575/1137] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:14:13 2022] GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98 => generated 1137 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:14:14.333487 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-74c0c49c-c6cb-4057-8b13-24e47ee9ae3f tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:14:14.334110 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-74c0c49c-c6cb-4057-8b13-24e47ee9ae3f tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] [instance: 4dc692c5-9b00-4551-a5f5-43277c08ba98] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:14:14.340534 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-74c0c49c-c6cb-4057-8b13-24e47ee9ae3f tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:14:14.341025 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-74c0c49c-c6cb-4057-8b13-24e47ee9ae3f tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:14:14.341464 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-74c0c49c-c6cb-4057-8b13-24e47ee9ae3f tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:14:14.342162 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-74c0c49c-c6cb-4057-8b13-24e47ee9ae3f tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:14:14.342619 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-74c0c49c-c6cb-4057-8b13-24e47ee9ae3f tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:14:14.343043 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-74c0c49c-c6cb-4057-8b13-24e47ee9ae3f tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:14:14.406735 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-74c0c49c-c6cb-4057-8b13-24e47ee9ae3f tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3333a4ba4204c80ac03c960bfb77ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bf0e348b4944e8907b80446a12a6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:14:14.414342 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-74c0c49c-c6cb-4057-8b13-24e47ee9ae3f tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] 10.222.0.42 "GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98" status: 200 len: 1203 microversion: 2.1 time: 0.084698 Sep 16 02:14:14.414917 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 563/1138] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:14:14 2022] GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98 => generated 1203 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:14:15.437930 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-a56c3f6b-6dba-4d04-838d-5d2527e425f0 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:14:15.438712 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-a56c3f6b-6dba-4d04-838d-5d2527e425f0 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] [instance: 4dc692c5-9b00-4551-a5f5-43277c08ba98] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:14:15.445226 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a56c3f6b-6dba-4d04-838d-5d2527e425f0 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:14:15.445646 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a56c3f6b-6dba-4d04-838d-5d2527e425f0 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:14:15.446079 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a56c3f6b-6dba-4d04-838d-5d2527e425f0 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:14:15.446925 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a56c3f6b-6dba-4d04-838d-5d2527e425f0 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:14:15.447387 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a56c3f6b-6dba-4d04-838d-5d2527e425f0 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:14:15.447806 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-a56c3f6b-6dba-4d04-838d-5d2527e425f0 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:14:15.560133 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [req-aa9d2af4-aa3d-4ab1-8994-b8241c588a8a req-a0692ed3-9eb8-40e2-853e-b8e18ca4b9c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dc692c5-9b00-4551-a5f5-43277c08ba98", "tag": "4c2f2ad7-8720-4f8e-9294-ca860089689f"}]} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:14:15.570490 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-aa9d2af4-aa3d-4ab1-8994-b8241c588a8a req-a0692ed3-9eb8-40e2-853e-b8e18ca4b9c6 service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:14:15.570941 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-aa9d2af4-aa3d-4ab1-8994-b8241c588a8a req-a0692ed3-9eb8-40e2-853e-b8e18ca4b9c6 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:14:15.571383 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-aa9d2af4-aa3d-4ab1-8994-b8241c588a8a req-a0692ed3-9eb8-40e2-853e-b8e18ca4b9c6 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:14:15.583496 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.compute.server_external_events [req-aa9d2af4-aa3d-4ab1-8994-b8241c588a8a req-a0692ed3-9eb8-40e2-853e-b8e18ca4b9c6 service nova] Creating event network-changed:4c2f2ad7-8720-4f8e-9294-ca860089689f for instance 4dc692c5-9b00-4551-a5f5-43277c08ba98 on hv-cinder-84914 Sep 16 02:14:15.589048 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [req-aa9d2af4-aa3d-4ab1-8994-b8241c588a8a req-a0692ed3-9eb8-40e2-853e-b8e18ca4b9c6 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032798 Sep 16 02:14:15.589649 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 564/1139] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:14:15 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 02:14:15.678581 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-a56c3f6b-6dba-4d04-838d-5d2527e425f0 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3333a4ba4204c80ac03c960bfb77ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bf0e348b4944e8907b80446a12a6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:14:15.686305 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-a56c3f6b-6dba-4d04-838d-5d2527e425f0 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] 10.222.0.42 "GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98" status: 200 len: 1258 microversion: 2.1 time: 0.252313 Sep 16 02:14:15.686886 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 576/1140] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:14:15 2022] GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98 => generated 1258 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:14:16.710565 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-887e1fbb-39f3-4003-856d-eccce3875f81 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:14:16.711258 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-887e1fbb-39f3-4003-856d-eccce3875f81 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] [instance: 4dc692c5-9b00-4551-a5f5-43277c08ba98] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:14:16.718045 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-887e1fbb-39f3-4003-856d-eccce3875f81 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:14:16.718529 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-887e1fbb-39f3-4003-856d-eccce3875f81 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:14:16.718971 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-887e1fbb-39f3-4003-856d-eccce3875f81 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:14:16.719653 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-887e1fbb-39f3-4003-856d-eccce3875f81 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:14:16.720149 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-887e1fbb-39f3-4003-856d-eccce3875f81 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:14:16.720610 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-887e1fbb-39f3-4003-856d-eccce3875f81 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:14:16.848335 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-887e1fbb-39f3-4003-856d-eccce3875f81 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3333a4ba4204c80ac03c960bfb77ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bf0e348b4944e8907b80446a12a6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:14:16.856165 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-887e1fbb-39f3-4003-856d-eccce3875f81 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] 10.222.0.42 "GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98" status: 200 len: 1258 microversion: 2.1 time: 0.150221 Sep 16 02:14:16.856737 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 565/1141] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:14:16 2022] GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98 => generated 1258 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:14:17.879196 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-2249a14c-41bd-4000-a442-c37096a5b003 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:14:17.879804 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-2249a14c-41bd-4000-a442-c37096a5b003 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] [instance: 4dc692c5-9b00-4551-a5f5-43277c08ba98] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:14:17.886736 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2249a14c-41bd-4000-a442-c37096a5b003 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:14:17.887285 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2249a14c-41bd-4000-a442-c37096a5b003 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:14:17.887717 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2249a14c-41bd-4000-a442-c37096a5b003 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:14:17.888482 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2249a14c-41bd-4000-a442-c37096a5b003 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:14:17.888927 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2249a14c-41bd-4000-a442-c37096a5b003 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:14:17.889341 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-2249a14c-41bd-4000-a442-c37096a5b003 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:14:18.016133 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-2249a14c-41bd-4000-a442-c37096a5b003 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3333a4ba4204c80ac03c960bfb77ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bf0e348b4944e8907b80446a12a6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:14:18.023634 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-2249a14c-41bd-4000-a442-c37096a5b003 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] 10.222.0.42 "GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98" status: 200 len: 1258 microversion: 2.1 time: 0.148379 Sep 16 02:14:18.024223 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 577/1142] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:14:17 2022] GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98 => generated 1258 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:14:19.046875 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-d8fa29d6-660f-4a10-a115-e6ded5531276 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:14:19.047491 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-d8fa29d6-660f-4a10-a115-e6ded5531276 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] [instance: 4dc692c5-9b00-4551-a5f5-43277c08ba98] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:14:19.054067 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d8fa29d6-660f-4a10-a115-e6ded5531276 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:14:19.054555 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d8fa29d6-660f-4a10-a115-e6ded5531276 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:14:19.054991 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d8fa29d6-660f-4a10-a115-e6ded5531276 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:14:19.055680 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d8fa29d6-660f-4a10-a115-e6ded5531276 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:14:19.056785 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d8fa29d6-660f-4a10-a115-e6ded5531276 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:14:19.057229 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-d8fa29d6-660f-4a10-a115-e6ded5531276 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:14:19.188821 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-d8fa29d6-660f-4a10-a115-e6ded5531276 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3333a4ba4204c80ac03c960bfb77ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bf0e348b4944e8907b80446a12a6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:14:19.196333 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-d8fa29d6-660f-4a10-a115-e6ded5531276 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] 10.222.0.42 "GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98" status: 200 len: 1258 microversion: 2.1 time: 0.153248 Sep 16 02:14:19.197024 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 566/1143] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:14:19 2022] GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98 => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:14:20.219173 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-ed2e2dc0-950c-4d5a-b93d-814588570c87 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:14:20.219797 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-ed2e2dc0-950c-4d5a-b93d-814588570c87 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] [instance: 4dc692c5-9b00-4551-a5f5-43277c08ba98] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:14:20.222122 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell0:SELECT=2 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:14:20.227582 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ed2e2dc0-950c-4d5a-b93d-814588570c87 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:14:20.228254 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ed2e2dc0-950c-4d5a-b93d-814588570c87 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:14:20.228714 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ed2e2dc0-950c-4d5a-b93d-814588570c87 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:14:20.229411 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ed2e2dc0-950c-4d5a-b93d-814588570c87 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:14:20.229865 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ed2e2dc0-950c-4d5a-b93d-814588570c87 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:14:20.230287 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ed2e2dc0-950c-4d5a-b93d-814588570c87 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:14:20.364516 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-ed2e2dc0-950c-4d5a-b93d-814588570c87 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3333a4ba4204c80ac03c960bfb77ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bf0e348b4944e8907b80446a12a6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:14:20.372996 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-ed2e2dc0-950c-4d5a-b93d-814588570c87 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] 10.222.0.42 "GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98" status: 200 len: 1258 microversion: 2.1 time: 0.157885 Sep 16 02:14:20.373566 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 578/1144] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:14:20 2022] GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98 => generated 1258 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:14:21.396274 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-16e98088-d8fc-4371-95eb-c30686f0978c tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:14:21.396890 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-16e98088-d8fc-4371-95eb-c30686f0978c tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] [instance: 4dc692c5-9b00-4551-a5f5-43277c08ba98] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:14:21.403808 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-16e98088-d8fc-4371-95eb-c30686f0978c tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:14:21.404318 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-16e98088-d8fc-4371-95eb-c30686f0978c tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:14:21.404754 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-16e98088-d8fc-4371-95eb-c30686f0978c tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:14:21.405440 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-16e98088-d8fc-4371-95eb-c30686f0978c tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:14:21.405892 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-16e98088-d8fc-4371-95eb-c30686f0978c tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:14:21.406312 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-16e98088-d8fc-4371-95eb-c30686f0978c tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:14:21.535536 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-16e98088-d8fc-4371-95eb-c30686f0978c tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3333a4ba4204c80ac03c960bfb77ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bf0e348b4944e8907b80446a12a6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:14:21.544722 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-16e98088-d8fc-4371-95eb-c30686f0978c tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] 10.222.0.42 "GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98" status: 200 len: 1258 microversion: 2.1 time: 0.152270 Sep 16 02:14:21.545291 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 567/1145] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:14:21 2022] GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98 => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:14:22.567674 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-5853891a-4d48-46e1-8374-af05cc9c1bbc tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:14:22.568316 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-5853891a-4d48-46e1-8374-af05cc9c1bbc tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] [instance: 4dc692c5-9b00-4551-a5f5-43277c08ba98] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:14:22.570121 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell0:SELECT=8 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:14:22.575819 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5853891a-4d48-46e1-8374-af05cc9c1bbc tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:14:22.576334 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5853891a-4d48-46e1-8374-af05cc9c1bbc tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:14:22.576782 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5853891a-4d48-46e1-8374-af05cc9c1bbc tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:14:22.577640 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5853891a-4d48-46e1-8374-af05cc9c1bbc tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:14:22.578092 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5853891a-4d48-46e1-8374-af05cc9c1bbc tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:14:22.578765 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5853891a-4d48-46e1-8374-af05cc9c1bbc tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:14:22.707544 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-5853891a-4d48-46e1-8374-af05cc9c1bbc tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3333a4ba4204c80ac03c960bfb77ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bf0e348b4944e8907b80446a12a6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:14:22.715626 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-5853891a-4d48-46e1-8374-af05cc9c1bbc tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] 10.222.0.42 "GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98" status: 200 len: 1258 microversion: 2.1 time: 0.152061 Sep 16 02:14:22.716224 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 579/1146] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:14:22 2022] GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98 => generated 1258 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:14:23.738774 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-f219b3b7-8867-4b10-893d-7fced97ef2a3 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:14:23.739396 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-f219b3b7-8867-4b10-893d-7fced97ef2a3 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] [instance: 4dc692c5-9b00-4551-a5f5-43277c08ba98] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:14:23.741389 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell0:SELECT=4 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:14:23.748196 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f219b3b7-8867-4b10-893d-7fced97ef2a3 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:14:23.748676 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f219b3b7-8867-4b10-893d-7fced97ef2a3 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:14:23.749109 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f219b3b7-8867-4b10-893d-7fced97ef2a3 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:14:23.749793 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f219b3b7-8867-4b10-893d-7fced97ef2a3 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:14:23.750245 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f219b3b7-8867-4b10-893d-7fced97ef2a3 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:14:23.750670 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f219b3b7-8867-4b10-893d-7fced97ef2a3 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:14:23.883004 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-f219b3b7-8867-4b10-893d-7fced97ef2a3 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3333a4ba4204c80ac03c960bfb77ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bf0e348b4944e8907b80446a12a6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:14:23.891283 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-f219b3b7-8867-4b10-893d-7fced97ef2a3 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] 10.222.0.42 "GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98" status: 200 len: 1258 microversion: 2.1 time: 0.156418 Sep 16 02:14:23.891838 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 568/1147] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:14:23 2022] GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98 => generated 1258 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:14:24.913985 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-66d2bf18-d321-44db-83e7-7beb97efcfb7 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:14:24.914603 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-66d2bf18-d321-44db-83e7-7beb97efcfb7 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] [instance: 4dc692c5-9b00-4551-a5f5-43277c08ba98] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:14:24.921185 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-66d2bf18-d321-44db-83e7-7beb97efcfb7 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:14:24.921670 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-66d2bf18-d321-44db-83e7-7beb97efcfb7 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:14:24.922107 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-66d2bf18-d321-44db-83e7-7beb97efcfb7 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:14:24.922793 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-66d2bf18-d321-44db-83e7-7beb97efcfb7 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:14:24.923248 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-66d2bf18-d321-44db-83e7-7beb97efcfb7 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:14:24.923669 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-66d2bf18-d321-44db-83e7-7beb97efcfb7 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:14:25.058691 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-66d2bf18-d321-44db-83e7-7beb97efcfb7 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3333a4ba4204c80ac03c960bfb77ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bf0e348b4944e8907b80446a12a6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:14:25.066294 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-66d2bf18-d321-44db-83e7-7beb97efcfb7 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] 10.222.0.42 "GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98" status: 200 len: 1258 microversion: 2.1 time: 0.156193 Sep 16 02:14:25.066796 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 580/1148] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:14:24 2022] GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98 => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:14:26.089894 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-24583dab-29ca-4846-9a48-c0123ed7dc50 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:14:26.090423 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-24583dab-29ca-4846-9a48-c0123ed7dc50 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] [instance: 4dc692c5-9b00-4551-a5f5-43277c08ba98] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:14:26.096796 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-24583dab-29ca-4846-9a48-c0123ed7dc50 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:14:26.097271 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-24583dab-29ca-4846-9a48-c0123ed7dc50 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:14:26.097701 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-24583dab-29ca-4846-9a48-c0123ed7dc50 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:14:26.098378 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-24583dab-29ca-4846-9a48-c0123ed7dc50 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:14:26.098823 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-24583dab-29ca-4846-9a48-c0123ed7dc50 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:14:26.099240 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-24583dab-29ca-4846-9a48-c0123ed7dc50 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:14:26.227344 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-24583dab-29ca-4846-9a48-c0123ed7dc50 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3333a4ba4204c80ac03c960bfb77ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bf0e348b4944e8907b80446a12a6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:14:26.235062 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-24583dab-29ca-4846-9a48-c0123ed7dc50 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] 10.222.0.42 "GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98" status: 200 len: 1258 microversion: 2.1 time: 0.149370 Sep 16 02:14:26.235627 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 569/1149] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:14:26 2022] GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98 => generated 1258 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:14:26.674765 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [req-a6651152-3995-4bb9-95be-f0a5e6556798 req-1a35e35d-df87-4e13-8ab5-cf996989d79e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dc692c5-9b00-4551-a5f5-43277c08ba98", "name": "network-vif-plugged", "status": "completed", "tag": "4c2f2ad7-8720-4f8e-9294-ca860089689f"}]} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:14:26.685118 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-a6651152-3995-4bb9-95be-f0a5e6556798 req-1a35e35d-df87-4e13-8ab5-cf996989d79e service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:14:26.685664 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-a6651152-3995-4bb9-95be-f0a5e6556798 req-1a35e35d-df87-4e13-8ab5-cf996989d79e service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:14:26.686097 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-a6651152-3995-4bb9-95be-f0a5e6556798 req-1a35e35d-df87-4e13-8ab5-cf996989d79e service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:14:26.697222 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.compute.server_external_events [req-a6651152-3995-4bb9-95be-f0a5e6556798 req-1a35e35d-df87-4e13-8ab5-cf996989d79e service nova] Creating event network-vif-plugged:4c2f2ad7-8720-4f8e-9294-ca860089689f for instance 4dc692c5-9b00-4551-a5f5-43277c08ba98 on hv-cinder-84914 Sep 16 02:14:26.702100 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [req-a6651152-3995-4bb9-95be-f0a5e6556798 req-1a35e35d-df87-4e13-8ab5-cf996989d79e service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031086 Sep 16 02:14:26.702685 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 581/1150] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:14:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:14:27.258967 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-ff38d0fb-fdfc-457b-bbe0-4268d5d6e260 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:14:27.259578 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-ff38d0fb-fdfc-457b-bbe0-4268d5d6e260 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] [instance: 4dc692c5-9b00-4551-a5f5-43277c08ba98] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:14:27.265949 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ff38d0fb-fdfc-457b-bbe0-4268d5d6e260 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:14:27.266426 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ff38d0fb-fdfc-457b-bbe0-4268d5d6e260 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:14:27.266857 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ff38d0fb-fdfc-457b-bbe0-4268d5d6e260 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:14:27.267533 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ff38d0fb-fdfc-457b-bbe0-4268d5d6e260 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:14:27.268000 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ff38d0fb-fdfc-457b-bbe0-4268d5d6e260 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:14:27.268514 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ff38d0fb-fdfc-457b-bbe0-4268d5d6e260 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:14:27.396483 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-ff38d0fb-fdfc-457b-bbe0-4268d5d6e260 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3333a4ba4204c80ac03c960bfb77ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bf0e348b4944e8907b80446a12a6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:14:27.404649 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-ff38d0fb-fdfc-457b-bbe0-4268d5d6e260 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] 10.222.0.42 "GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98" status: 200 len: 1258 microversion: 2.1 time: 0.149574 Sep 16 02:14:27.405208 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 570/1151] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:14:27 2022] GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98 => generated 1258 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:14:28.428239 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-24d211d6-55e2-45e9-a092-a7fe96262726 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:14:28.429023 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-24d211d6-55e2-45e9-a092-a7fe96262726 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] [instance: 4dc692c5-9b00-4551-a5f5-43277c08ba98] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:14:28.436380 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-24d211d6-55e2-45e9-a092-a7fe96262726 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:14:28.436380 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-24d211d6-55e2-45e9-a092-a7fe96262726 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:14:28.436678 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-24d211d6-55e2-45e9-a092-a7fe96262726 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:14:28.437183 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-24d211d6-55e2-45e9-a092-a7fe96262726 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:14:28.437699 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-24d211d6-55e2-45e9-a092-a7fe96262726 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:14:28.438156 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-24d211d6-55e2-45e9-a092-a7fe96262726 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:14:28.569957 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-24d211d6-55e2-45e9-a092-a7fe96262726 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3333a4ba4204c80ac03c960bfb77ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bf0e348b4944e8907b80446a12a6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:14:28.578546 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-24d211d6-55e2-45e9-a092-a7fe96262726 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] 10.222.0.42 "GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98" status: 200 len: 1258 microversion: 2.1 time: 0.155089 Sep 16 02:14:28.579292 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 582/1152] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:14:28 2022] GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98 => generated 1258 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:14:29.602789 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-99bfdbf9-faa1-4412-9a1b-4817e438418d tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:14:29.603510 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-99bfdbf9-faa1-4412-9a1b-4817e438418d tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] [instance: 4dc692c5-9b00-4551-a5f5-43277c08ba98] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:14:29.609849 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-99bfdbf9-faa1-4412-9a1b-4817e438418d tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:14:29.610323 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-99bfdbf9-faa1-4412-9a1b-4817e438418d tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:14:29.610751 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-99bfdbf9-faa1-4412-9a1b-4817e438418d tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:14:29.611427 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-99bfdbf9-faa1-4412-9a1b-4817e438418d tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:14:29.611872 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-99bfdbf9-faa1-4412-9a1b-4817e438418d tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:14:29.612313 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-99bfdbf9-faa1-4412-9a1b-4817e438418d tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:14:29.743491 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-99bfdbf9-faa1-4412-9a1b-4817e438418d tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3333a4ba4204c80ac03c960bfb77ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bf0e348b4944e8907b80446a12a6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:14:29.751360 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-99bfdbf9-faa1-4412-9a1b-4817e438418d tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] 10.222.0.42 "GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98" status: 200 len: 1441 microversion: 2.1 time: 0.153068 Sep 16 02:14:29.751927 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 571/1153] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:14:29 2022] GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98 => generated 1441 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:14:29.772855 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-f17abe70-ffc1-4559-bff4-1af1d5cd81a2 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:14:29.773463 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-f17abe70-ffc1-4559-bff4-1af1d5cd81a2 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] [instance: 4dc692c5-9b00-4551-a5f5-43277c08ba98] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:14:29.780378 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f17abe70-ffc1-4559-bff4-1af1d5cd81a2 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:14:29.780856 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f17abe70-ffc1-4559-bff4-1af1d5cd81a2 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:14:29.781287 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f17abe70-ffc1-4559-bff4-1af1d5cd81a2 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:14:29.781962 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f17abe70-ffc1-4559-bff4-1af1d5cd81a2 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:14:29.782409 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f17abe70-ffc1-4559-bff4-1af1d5cd81a2 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:14:29.782828 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f17abe70-ffc1-4559-bff4-1af1d5cd81a2 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:14:29.915456 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-f17abe70-ffc1-4559-bff4-1af1d5cd81a2 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3333a4ba4204c80ac03c960bfb77ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bf0e348b4944e8907b80446a12a6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:14:29.923190 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-f17abe70-ffc1-4559-bff4-1af1d5cd81a2 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] 10.222.0.42 "GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98" status: 200 len: 1441 microversion: 2.1 time: 0.154114 Sep 16 02:14:29.923753 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 583/1154] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:14:29 2022] GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98 => generated 1441 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:14:31.786630 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [req-545549e2-7288-49f7-bc27-c9d06a562c8a req-7e5603dd-0d05-429a-8c3f-0d5c778f8689 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dc692c5-9b00-4551-a5f5-43277c08ba98", "tag": "4c2f2ad7-8720-4f8e-9294-ca860089689f"}]} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:14:31.796678 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-545549e2-7288-49f7-bc27-c9d06a562c8a req-7e5603dd-0d05-429a-8c3f-0d5c778f8689 service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:14:31.797217 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-545549e2-7288-49f7-bc27-c9d06a562c8a req-7e5603dd-0d05-429a-8c3f-0d5c778f8689 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:14:31.797653 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-545549e2-7288-49f7-bc27-c9d06a562c8a req-7e5603dd-0d05-429a-8c3f-0d5c778f8689 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:14:31.809350 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.compute.server_external_events [req-545549e2-7288-49f7-bc27-c9d06a562c8a req-7e5603dd-0d05-429a-8c3f-0d5c778f8689 service nova] Creating event network-changed:4c2f2ad7-8720-4f8e-9294-ca860089689f for instance 4dc692c5-9b00-4551-a5f5-43277c08ba98 on hv-cinder-84914 Sep 16 02:14:31.814479 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [req-545549e2-7288-49f7-bc27-c9d06a562c8a req-7e5603dd-0d05-429a-8c3f-0d5c778f8689 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.091211 Sep 16 02:14:31.815016 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 572/1155] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:14:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:15:50.970200 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_api:SELECT=32,nova_api:INSERT=3 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:15:50.971312 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell1:SELECT=52 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:15:50.973998 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_api:SELECT=27 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:15:50.975179 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell1:SELECT=52 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:15:50.976906 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-12acb73e-1aa7-4c9e-979b-213d344d9d9f tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:15:50.977453 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-12acb73e-1aa7-4c9e-979b-213d344d9d9f tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: ff79691f-7595-4bec-92bd-4a636d9d9de0] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:15:50.981898 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [req-591d7e07-11c8-4688-ba90-1f25911d92fe req-cd8425ce-a604-475c-bdec-fdef378eb879 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ff79691f-7595-4bec-92bd-4a636d9d9de0", "tag": "cd5e9a80-fe4d-44cf-94e7-64bafb6d27b1"}]} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:15:50.984861 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-12acb73e-1aa7-4c9e-979b-213d344d9d9f tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:15:50.985359 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-12acb73e-1aa7-4c9e-979b-213d344d9d9f tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:15:50.985800 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-12acb73e-1aa7-4c9e-979b-213d344d9d9f tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:15:50.986501 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-12acb73e-1aa7-4c9e-979b-213d344d9d9f tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:15:50.986955 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-12acb73e-1aa7-4c9e-979b-213d344d9d9f tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:15:50.987630 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-12acb73e-1aa7-4c9e-979b-213d344d9d9f tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:15:50.992830 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-591d7e07-11c8-4688-ba90-1f25911d92fe req-cd8425ce-a604-475c-bdec-fdef378eb879 service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:15:50.993603 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-591d7e07-11c8-4688-ba90-1f25911d92fe req-cd8425ce-a604-475c-bdec-fdef378eb879 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:15:50.994353 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-591d7e07-11c8-4688-ba90-1f25911d92fe req-cd8425ce-a604-475c-bdec-fdef378eb879 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:15:51.006018 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.compute.server_external_events [req-591d7e07-11c8-4688-ba90-1f25911d92fe req-cd8425ce-a604-475c-bdec-fdef378eb879 service nova] Creating event network-changed:cd5e9a80-fe4d-44cf-94e7-64bafb6d27b1 for instance ff79691f-7595-4bec-92bd-4a636d9d9de0 on hv-cinder-84914 Sep 16 02:15:51.012692 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [req-591d7e07-11c8-4688-ba90-1f25911d92fe req-cd8425ce-a604-475c-bdec-fdef378eb879 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041331 Sep 16 02:15:51.013638 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 573/1156] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:15:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:15:51.016970 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-12acb73e-1aa7-4c9e-979b-213d344d9d9f tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: ff79691f-7595-4bec-92bd-4a636d9d9de0] Going to try to terminate instance {{(pid=120441) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 02:15:51.115616 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-12acb73e-1aa7-4c9e-979b-213d344d9d9f tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "DELETE /compute/v2.1/servers/ff79691f-7595-4bec-92bd-4a636d9d9de0" status: 204 len: 0 microversion: 2.1 time: 0.147143 Sep 16 02:15:51.116400 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 584/1157] 10.222.0.42 () {58 vars in 1239 bytes} [Fri Sep 16 02:15:50 2022] DELETE /compute/v2.1/servers/ff79691f-7595-4bec-92bd-4a636d9d9de0 => generated 0 bytes in 149 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 02:15:51.125976 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-ef9b20d1-70f1-4c64-a701-eaa925d98fb6 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:15:51.126918 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-ef9b20d1-70f1-4c64-a701-eaa925d98fb6 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: ff79691f-7595-4bec-92bd-4a636d9d9de0] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:15:51.133265 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ef9b20d1-70f1-4c64-a701-eaa925d98fb6 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:15:51.133747 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ef9b20d1-70f1-4c64-a701-eaa925d98fb6 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:15:51.134177 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ef9b20d1-70f1-4c64-a701-eaa925d98fb6 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:15:51.134908 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ef9b20d1-70f1-4c64-a701-eaa925d98fb6 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:15:51.135349 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ef9b20d1-70f1-4c64-a701-eaa925d98fb6 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:15:51.135769 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ef9b20d1-70f1-4c64-a701-eaa925d98fb6 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:15:51.329799 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-ef9b20d1-70f1-4c64-a701-eaa925d98fb6 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:15:51.338310 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-ef9b20d1-70f1-4c64-a701-eaa925d98fb6 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/ff79691f-7595-4bec-92bd-4a636d9d9de0" status: 200 len: 1576 microversion: 2.1 time: 0.215906 Sep 16 02:15:51.338879 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 574/1158] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:15:51 2022] GET /compute/v2.1/servers/ff79691f-7595-4bec-92bd-4a636d9d9de0 => generated 1576 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 02:15:52.363103 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-5ebae4b6-85c3-41e3-bb7d-d6a19020e179 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:15:52.363808 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-5ebae4b6-85c3-41e3-bb7d-d6a19020e179 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: ff79691f-7595-4bec-92bd-4a636d9d9de0] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:15:52.366331 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR oslo.messaging._drivers.impl_rabbit [-] [02684334-8414-41d0-a8c7-f7524462f6dc] AMQP server on 10.222.0.42:5672 is unreachable: . Trying again in 1 seconds.: amqp.exceptions.RecoverableConnectionError: Sep 16 02:15:52.371773 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5ebae4b6-85c3-41e3-bb7d-d6a19020e179 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:15:52.372292 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5ebae4b6-85c3-41e3-bb7d-d6a19020e179 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:15:52.372727 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5ebae4b6-85c3-41e3-bb7d-d6a19020e179 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:15:52.373443 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5ebae4b6-85c3-41e3-bb7d-d6a19020e179 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:15:52.373912 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5ebae4b6-85c3-41e3-bb7d-d6a19020e179 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:15:52.374335 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5ebae4b6-85c3-41e3-bb7d-d6a19020e179 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:15:52.568443 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-5ebae4b6-85c3-41e3-bb7d-d6a19020e179 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:15:52.576266 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-5ebae4b6-85c3-41e3-bb7d-d6a19020e179 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/ff79691f-7595-4bec-92bd-4a636d9d9de0" status: 200 len: 1576 microversion: 2.1 time: 0.217380 Sep 16 02:15:52.576828 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 585/1159] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:15:52 2022] GET /compute/v2.1/servers/ff79691f-7595-4bec-92bd-4a636d9d9de0 => generated 1576 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:15:53.580222 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [req-f485e1cd-e43f-4db3-956a-2cb4d59869b7 req-6be80c71-b8da-4e69-aec2-f6aacd143892 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ff79691f-7595-4bec-92bd-4a636d9d9de0", "name": "network-vif-deleted", "tag": "cd5e9a80-fe4d-44cf-94e7-64bafb6d27b1"}]} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:15:53.590351 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-f485e1cd-e43f-4db3-956a-2cb4d59869b7 req-6be80c71-b8da-4e69-aec2-f6aacd143892 service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:15:53.591139 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-f485e1cd-e43f-4db3-956a-2cb4d59869b7 req-6be80c71-b8da-4e69-aec2-f6aacd143892 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:15:53.591571 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-f485e1cd-e43f-4db3-956a-2cb4d59869b7 req-6be80c71-b8da-4e69-aec2-f6aacd143892 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:15:53.600620 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-27ed5c4c-2949-4c6f-b4d8-36d12949b39c tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:15:53.601254 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-27ed5c4c-2949-4c6f-b4d8-36d12949b39c tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: ff79691f-7595-4bec-92bd-4a636d9d9de0] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:15:53.603298 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.compute.server_external_events [req-f485e1cd-e43f-4db3-956a-2cb4d59869b7 req-6be80c71-b8da-4e69-aec2-f6aacd143892 service nova] Creating event network-vif-deleted:cd5e9a80-fe4d-44cf-94e7-64bafb6d27b1 for instance ff79691f-7595-4bec-92bd-4a636d9d9de0 on hv-cinder-84914 Sep 16 02:15:53.608504 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [req-f485e1cd-e43f-4db3-956a-2cb4d59869b7 req-6be80c71-b8da-4e69-aec2-f6aacd143892 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086643 Sep 16 02:15:53.609001 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-27ed5c4c-2949-4c6f-b4d8-36d12949b39c tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:15:53.609136 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 575/1160] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:15:53 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:15:53.609551 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-27ed5c4c-2949-4c6f-b4d8-36d12949b39c tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:15:53.609983 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-27ed5c4c-2949-4c6f-b4d8-36d12949b39c tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:15:53.611178 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-27ed5c4c-2949-4c6f-b4d8-36d12949b39c tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:15:53.611851 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-27ed5c4c-2949-4c6f-b4d8-36d12949b39c tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:15:53.612181 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-27ed5c4c-2949-4c6f-b4d8-36d12949b39c tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:15:53.619284 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO oslo.messaging._drivers.impl_rabbit [-] [02684334-8414-41d0-a8c7-f7524462f6dc] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 40402. Sep 16 02:15:53.679076 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-27ed5c4c-2949-4c6f-b4d8-36d12949b39c tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:15:53.687350 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-27ed5c4c-2949-4c6f-b4d8-36d12949b39c tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/ff79691f-7595-4bec-92bd-4a636d9d9de0" status: 200 len: 1226 microversion: 2.1 time: 0.090640 Sep 16 02:15:53.687958 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 586/1161] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:15:53 2022] GET /compute/v2.1/servers/ff79691f-7595-4bec-92bd-4a636d9d9de0 => generated 1226 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 02:15:54.711520 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-69cb7bec-f8bf-4a02-b2d1-44d616b83ba7 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:15:54.712257 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-69cb7bec-f8bf-4a02-b2d1-44d616b83ba7 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: ff79691f-7595-4bec-92bd-4a636d9d9de0] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:15:54.718309 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-69cb7bec-f8bf-4a02-b2d1-44d616b83ba7 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:15:54.718800 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-69cb7bec-f8bf-4a02-b2d1-44d616b83ba7 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:15:54.719234 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-69cb7bec-f8bf-4a02-b2d1-44d616b83ba7 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:15:54.719925 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-69cb7bec-f8bf-4a02-b2d1-44d616b83ba7 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:15:54.720447 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-69cb7bec-f8bf-4a02-b2d1-44d616b83ba7 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:15:54.720874 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-69cb7bec-f8bf-4a02-b2d1-44d616b83ba7 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:15:54.736424 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.wsgi [None req-69cb7bec-f8bf-4a02-b2d1-44d616b83ba7 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] HTTP exception thrown: Instance ff79691f-7595-4bec-92bd-4a636d9d9de0 could not be found. Sep 16 02:15:54.738013 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-69cb7bec-f8bf-4a02-b2d1-44d616b83ba7 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Request method failure captured: Sep 16 02:15:54.738013 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: request: GET /compute/v2.1/servers/ff79691f-7595-4bec-92bd-4a636d9d9de0 HTTP/1.1 Sep 16 02:15:54.738013 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept: application/json Sep 16 02:15:54.738013 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept-Encoding: identity Sep 16 02:15:54.738013 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Connection: close Sep 16 02:15:54.738013 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Length: 0 Sep 16 02:15:54.738013 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Type: application/json Sep 16 02:15:54.738013 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Host: 10.222.0.42 Sep 16 02:15:54.738013 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Openstack-System-Scope: None Sep 16 02:15:54.738013 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: User-Agent: python-urllib3/1.26.12 Sep 16 02:15:54.738013 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Auth-Token: gAAAAABjI9p8TdjH_kwBdldDF3CEs8I-vUyEHyLFI9oJxz2KE9pQ1dnvHn6dUCFQWAJkaiyVsVT2er0HnGWs49wNmoEdAyHHD4Cyp-FSTYX5lE5pMNkeMgCJjSiOjywjN66polzI7ozDE0K2Ot_nthdrnO4uhqOrWK34j169f1muJ7tt4Zo1oh8 Sep 16 02:15:54.738013 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Id: None Sep 16 02:15:54.738013 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Name: None Sep 16 02:15:54.738013 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Identity-Status: Confirmed Sep 16 02:15:54.738013 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Is-Admin-Project: True Sep 16 02:15:54.738013 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Id: default Sep 16 02:15:54.738013 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Name: Default Sep 16 02:15:54.738013 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Id: 9cfcd2376b1c4398befa49b423aaae26 Sep 16 02:15:54.738013 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Name: tempest-TestVolumeBootPattern-1895408842 Sep 16 02:15:54.738013 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Role: member,reader Sep 16 02:15:54.738013 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Roles: member,reader Sep 16 02:15:54.739826 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9cfcd2376b1c4398befa49b423aaae26"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9cfcd2376b1c4398befa49b423aaae26"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9cfcd2376b1c4398befa49b423aaae26"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9cfcd2376b1c4398befa49b423aaae26"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 02:15:54.739826 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant: tempest-TestVolumeBootPattern-1895408842 Sep 16 02:15:54.739826 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Id: 9cfcd2376b1c4398befa49b423aaae26 Sep 16 02:15:54.739826 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Name: tempest-TestVolumeBootPattern-1895408842 Sep 16 02:15:54.739826 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User: tempest-TestVolumeBootPattern-1895408842-project Sep 16 02:15:54.739826 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Id: default Sep 16 02:15:54.739826 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Name: Default Sep 16 02:15:54.739826 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Id: 772659a1932d45dea2c5120c4497314b Sep 16 02:15:54.739826 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Name: tempest-TestVolumeBootPattern-1895408842-project Sep 16 02:15:54.739826 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: method: > Sep 16 02:15:54.739826 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: exception: Instance ff79691f-7595-4bec-92bd-4a636d9d9de0 could not be found. Sep 16 02:15:54.739826 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: action_args: {'id': 'ff79691f-7595-4bec-92bd-4a636d9d9de0'} Sep 16 02:15:54.741040 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 02:15:54.741040 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:15:54.741040 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 02:15:54.741040 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 02:15:54.741040 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 02:15:54.741040 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 02:15:54.741040 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 02:15:54.741040 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 02:15:54.741040 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 02:15:54.741040 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 02:15:54.741040 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ff79691f-7595-4bec-92bd-4a636d9d9de0 could not be found. Sep 16 02:15:54.741040 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:15:54.741040 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:15:54.741040 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:15:54.741040 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:15:54.741040 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:15:54.741040 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:15:54.741040 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 02:15:54.741040 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 02:15:54.741040 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 02:15:54.742728 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 02:15:54.742728 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 02:15:54.742728 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 02:15:54.742728 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 02:15:54.742728 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 02:15:54.742728 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 02:15:54.742728 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 02:15:54.742728 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ff79691f-7595-4bec-92bd-4a636d9d9de0 could not be found. Sep 16 02:15:54.742728 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:15:54.742728 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:15:54.742728 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:15:54.742728 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:15:54.742728 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:15:54.742728 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:15:54.742728 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 02:15:54.742728 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 02:15:54.742728 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ff79691f-7595-4bec-92bd-4a636d9d9de0 could not be found. Sep 16 02:15:54.742728 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:15:54.745236 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-69cb7bec-f8bf-4a02-b2d1-44d616b83ba7 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Returning 404 to user: Instance ff79691f-7595-4bec-92bd-4a636d9d9de0 could not be found. {{(pid=120440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 02:15:54.745236 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-69cb7bec-f8bf-4a02-b2d1-44d616b83ba7 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/ff79691f-7595-4bec-92bd-4a636d9d9de0" status: 404 len: 111 microversion: 2.1 time: 0.032520 Sep 16 02:15:54.745236 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 576/1162] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:15:54 2022] GET /compute/v2.1/servers/ff79691f-7595-4bec-92bd-4a636d9d9de0 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 02:15:57.843917 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-e578ee19-b0c0-4857-8522-c7d1cf956056 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:15:57.844510 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-e578ee19-b0c0-4857-8522-c7d1cf956056 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: db657714-7c42-4b17-9954-8ad0a4e2ccba] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:15:57.845505 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [req-d5eb4c60-56ac-4335-8fb3-85145ff723a9 req-441f31a2-f934-40c7-b052-64daa4d859da service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "db657714-7c42-4b17-9954-8ad0a4e2ccba", "tag": "8cfd42e0-f275-4fb7-b9b7-11b1d2222158"}]} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:15:57.851332 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e578ee19-b0c0-4857-8522-c7d1cf956056 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:15:57.852126 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e578ee19-b0c0-4857-8522-c7d1cf956056 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:15:57.852640 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e578ee19-b0c0-4857-8522-c7d1cf956056 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:15:57.853374 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e578ee19-b0c0-4857-8522-c7d1cf956056 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:15:57.853815 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e578ee19-b0c0-4857-8522-c7d1cf956056 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:15:57.854434 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e578ee19-b0c0-4857-8522-c7d1cf956056 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:15:57.855871 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-d5eb4c60-56ac-4335-8fb3-85145ff723a9 req-441f31a2-f934-40c7-b052-64daa4d859da service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:15:57.856502 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-d5eb4c60-56ac-4335-8fb3-85145ff723a9 req-441f31a2-f934-40c7-b052-64daa4d859da service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:15:57.856996 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-d5eb4c60-56ac-4335-8fb3-85145ff723a9 req-441f31a2-f934-40c7-b052-64daa4d859da service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:15:57.871840 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.compute.server_external_events [req-d5eb4c60-56ac-4335-8fb3-85145ff723a9 req-441f31a2-f934-40c7-b052-64daa4d859da service nova] Creating event network-changed:8cfd42e0-f275-4fb7-b9b7-11b1d2222158 for instance db657714-7c42-4b17-9954-8ad0a4e2ccba on hv-cinder-84914 Sep 16 02:15:57.878280 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [req-d5eb4c60-56ac-4335-8fb3-85145ff723a9 req-441f31a2-f934-40c7-b052-64daa4d859da service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036467 Sep 16 02:15:57.878889 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 577/1163] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:15:57.889384 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-e578ee19-b0c0-4857-8522-c7d1cf956056 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: db657714-7c42-4b17-9954-8ad0a4e2ccba] Going to try to terminate instance {{(pid=120441) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 02:15:57.984796 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-e578ee19-b0c0-4857-8522-c7d1cf956056 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "DELETE /compute/v2.1/servers/db657714-7c42-4b17-9954-8ad0a4e2ccba" status: 204 len: 0 microversion: 2.1 time: 0.144202 Sep 16 02:15:57.986390 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 587/1164] 10.222.0.42 () {58 vars in 1239 bytes} [Fri Sep 16 02:15:57 2022] DELETE /compute/v2.1/servers/db657714-7c42-4b17-9954-8ad0a4e2ccba => generated 0 bytes in 147 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 02:15:57.995785 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-3ed9239b-6ec9-4ee8-befd-f515c1e63ada tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:15:57.996554 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-3ed9239b-6ec9-4ee8-befd-f515c1e63ada tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: db657714-7c42-4b17-9954-8ad0a4e2ccba] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:15:58.003168 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3ed9239b-6ec9-4ee8-befd-f515c1e63ada tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:15:58.003655 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3ed9239b-6ec9-4ee8-befd-f515c1e63ada tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:15:58.004131 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3ed9239b-6ec9-4ee8-befd-f515c1e63ada tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:15:58.004830 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3ed9239b-6ec9-4ee8-befd-f515c1e63ada tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:15:58.005312 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3ed9239b-6ec9-4ee8-befd-f515c1e63ada tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:15:58.005736 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-3ed9239b-6ec9-4ee8-befd-f515c1e63ada tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:15:58.141222 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-3ed9239b-6ec9-4ee8-befd-f515c1e63ada tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:15:58.148913 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-3ed9239b-6ec9-4ee8-befd-f515c1e63ada tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/db657714-7c42-4b17-9954-8ad0a4e2ccba" status: 200 len: 1577 microversion: 2.1 time: 0.157965 Sep 16 02:15:58.149490 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 578/1165] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:15:57 2022] GET /compute/v2.1/servers/db657714-7c42-4b17-9954-8ad0a4e2ccba => generated 1577 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:15:59.174356 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-fbd11877-446f-4fd8-9705-1d78b65c502c tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:15:59.175211 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-fbd11877-446f-4fd8-9705-1d78b65c502c tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: db657714-7c42-4b17-9954-8ad0a4e2ccba] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:15:59.181891 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fbd11877-446f-4fd8-9705-1d78b65c502c tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:15:59.182461 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fbd11877-446f-4fd8-9705-1d78b65c502c tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:15:59.182903 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fbd11877-446f-4fd8-9705-1d78b65c502c tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:15:59.183602 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fbd11877-446f-4fd8-9705-1d78b65c502c tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:15:59.184085 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fbd11877-446f-4fd8-9705-1d78b65c502c tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:15:59.184510 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fbd11877-446f-4fd8-9705-1d78b65c502c tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:15:59.381275 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-fbd11877-446f-4fd8-9705-1d78b65c502c tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:15:59.389774 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-fbd11877-446f-4fd8-9705-1d78b65c502c tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/db657714-7c42-4b17-9954-8ad0a4e2ccba" status: 200 len: 1577 microversion: 2.1 time: 0.219778 Sep 16 02:15:59.390338 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 588/1166] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:15:59 2022] GET /compute/v2.1/servers/db657714-7c42-4b17-9954-8ad0a4e2ccba => generated 1577 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:16:00.413150 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-39335499-b34c-403a-ab96-db1f65e54f90 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:16:00.413753 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-39335499-b34c-403a-ab96-db1f65e54f90 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: db657714-7c42-4b17-9954-8ad0a4e2ccba] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:16:00.420485 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-39335499-b34c-403a-ab96-db1f65e54f90 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:16:00.420966 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-39335499-b34c-403a-ab96-db1f65e54f90 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:16:00.421398 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-39335499-b34c-403a-ab96-db1f65e54f90 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:16:00.422085 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-39335499-b34c-403a-ab96-db1f65e54f90 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:16:00.422534 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-39335499-b34c-403a-ab96-db1f65e54f90 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:16:00.422956 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-39335499-b34c-403a-ab96-db1f65e54f90 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:16:00.491243 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-39335499-b34c-403a-ab96-db1f65e54f90 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '772659a1932d45dea2c5120c4497314b', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9cfcd2376b1c4398befa49b423aaae26', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:16:00.501824 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-39335499-b34c-403a-ab96-db1f65e54f90 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/db657714-7c42-4b17-9954-8ad0a4e2ccba" status: 200 len: 1391 microversion: 2.1 time: 0.092480 Sep 16 02:16:00.502413 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 579/1167] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:16:00 2022] GET /compute/v2.1/servers/db657714-7c42-4b17-9954-8ad0a4e2ccba => generated 1391 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:16:00.544966 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [req-8d873eab-a1d4-42c2-8272-7cadefec3ef1 req-c4f126aa-b235-47cf-b532-f3b119c26a34 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "db657714-7c42-4b17-9954-8ad0a4e2ccba", "name": "network-vif-deleted", "tag": "8cfd42e0-f275-4fb7-b9b7-11b1d2222158"}]} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:16:00.558364 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-8d873eab-a1d4-42c2-8272-7cadefec3ef1 req-c4f126aa-b235-47cf-b532-f3b119c26a34 service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:16:00.558863 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-8d873eab-a1d4-42c2-8272-7cadefec3ef1 req-c4f126aa-b235-47cf-b532-f3b119c26a34 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:16:00.559285 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-8d873eab-a1d4-42c2-8272-7cadefec3ef1 req-c4f126aa-b235-47cf-b532-f3b119c26a34 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:16:00.570178 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.compute.server_external_events [req-8d873eab-a1d4-42c2-8272-7cadefec3ef1 req-c4f126aa-b235-47cf-b532-f3b119c26a34 service nova] Creating event network-vif-deleted:8cfd42e0-f275-4fb7-b9b7-11b1d2222158 for instance db657714-7c42-4b17-9954-8ad0a4e2ccba on hv-cinder-84914 Sep 16 02:16:00.576878 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [req-8d873eab-a1d4-42c2-8272-7cadefec3ef1 req-c4f126aa-b235-47cf-b532-f3b119c26a34 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036078 Sep 16 02:16:00.577806 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 589/1168] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:16:01.525779 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-bd6a9a33-ac01-40c5-adf1-72a20e8dff7d tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:16:01.526398 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-bd6a9a33-ac01-40c5-adf1-72a20e8dff7d tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: db657714-7c42-4b17-9954-8ad0a4e2ccba] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:16:01.532999 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bd6a9a33-ac01-40c5-adf1-72a20e8dff7d tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:16:01.533422 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bd6a9a33-ac01-40c5-adf1-72a20e8dff7d tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:16:01.533858 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bd6a9a33-ac01-40c5-adf1-72a20e8dff7d tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:16:01.534541 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bd6a9a33-ac01-40c5-adf1-72a20e8dff7d tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:16:01.534990 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bd6a9a33-ac01-40c5-adf1-72a20e8dff7d tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:16:01.535411 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-bd6a9a33-ac01-40c5-adf1-72a20e8dff7d tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:16:01.548574 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.wsgi [None req-bd6a9a33-ac01-40c5-adf1-72a20e8dff7d tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] HTTP exception thrown: Instance db657714-7c42-4b17-9954-8ad0a4e2ccba could not be found. Sep 16 02:16:01.550189 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-bd6a9a33-ac01-40c5-adf1-72a20e8dff7d tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Request method failure captured: Sep 16 02:16:01.550189 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: request: GET /compute/v2.1/servers/db657714-7c42-4b17-9954-8ad0a4e2ccba HTTP/1.1 Sep 16 02:16:01.550189 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept: application/json Sep 16 02:16:01.550189 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept-Encoding: identity Sep 16 02:16:01.550189 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Connection: close Sep 16 02:16:01.550189 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Length: 0 Sep 16 02:16:01.550189 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Type: application/json Sep 16 02:16:01.550189 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Host: 10.222.0.42 Sep 16 02:16:01.550189 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Openstack-System-Scope: None Sep 16 02:16:01.550189 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: User-Agent: python-urllib3/1.26.12 Sep 16 02:16:01.550189 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Auth-Token: gAAAAABjI9p8TdjH_kwBdldDF3CEs8I-vUyEHyLFI9oJxz2KE9pQ1dnvHn6dUCFQWAJkaiyVsVT2er0HnGWs49wNmoEdAyHHD4Cyp-FSTYX5lE5pMNkeMgCJjSiOjywjN66polzI7ozDE0K2Ot_nthdrnO4uhqOrWK34j169f1muJ7tt4Zo1oh8 Sep 16 02:16:01.550189 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Id: None Sep 16 02:16:01.550189 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Name: None Sep 16 02:16:01.550189 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Identity-Status: Confirmed Sep 16 02:16:01.550189 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Is-Admin-Project: True Sep 16 02:16:01.550189 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Id: default Sep 16 02:16:01.550189 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Name: Default Sep 16 02:16:01.550189 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Id: 9cfcd2376b1c4398befa49b423aaae26 Sep 16 02:16:01.550189 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Name: tempest-TestVolumeBootPattern-1895408842 Sep 16 02:16:01.550189 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Role: member,reader Sep 16 02:16:01.550189 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Roles: member,reader Sep 16 02:16:01.551867 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9cfcd2376b1c4398befa49b423aaae26"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9cfcd2376b1c4398befa49b423aaae26"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9cfcd2376b1c4398befa49b423aaae26"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9cfcd2376b1c4398befa49b423aaae26"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 02:16:01.551867 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant: tempest-TestVolumeBootPattern-1895408842 Sep 16 02:16:01.551867 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Id: 9cfcd2376b1c4398befa49b423aaae26 Sep 16 02:16:01.551867 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Name: tempest-TestVolumeBootPattern-1895408842 Sep 16 02:16:01.551867 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User: tempest-TestVolumeBootPattern-1895408842-project Sep 16 02:16:01.551867 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Id: default Sep 16 02:16:01.551867 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Name: Default Sep 16 02:16:01.551867 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Id: 772659a1932d45dea2c5120c4497314b Sep 16 02:16:01.551867 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Name: tempest-TestVolumeBootPattern-1895408842-project Sep 16 02:16:01.551867 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: method: > Sep 16 02:16:01.551867 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: exception: Instance db657714-7c42-4b17-9954-8ad0a4e2ccba could not be found. Sep 16 02:16:01.551867 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: action_args: {'id': 'db657714-7c42-4b17-9954-8ad0a4e2ccba'} Sep 16 02:16:01.553032 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 02:16:01.553032 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:16:01.553032 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 02:16:01.553032 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 02:16:01.553032 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 02:16:01.553032 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 02:16:01.553032 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 02:16:01.553032 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 02:16:01.553032 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 02:16:01.553032 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 02:16:01.553032 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance db657714-7c42-4b17-9954-8ad0a4e2ccba could not be found. Sep 16 02:16:01.553032 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:16:01.553032 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:16:01.553032 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:16:01.553032 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:16:01.553032 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:16:01.553032 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:16:01.553032 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 02:16:01.553032 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 02:16:01.553032 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 02:16:01.554609 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 02:16:01.554609 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 02:16:01.554609 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 02:16:01.554609 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 02:16:01.554609 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 02:16:01.554609 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 02:16:01.554609 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 02:16:01.554609 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance db657714-7c42-4b17-9954-8ad0a4e2ccba could not be found. Sep 16 02:16:01.554609 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:16:01.554609 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:16:01.554609 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:16:01.554609 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:16:01.554609 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:16:01.554609 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:16:01.554609 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 02:16:01.554609 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 02:16:01.554609 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance db657714-7c42-4b17-9954-8ad0a4e2ccba could not be found. Sep 16 02:16:01.554609 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:16:01.556441 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-bd6a9a33-ac01-40c5-adf1-72a20e8dff7d tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Returning 404 to user: Instance db657714-7c42-4b17-9954-8ad0a4e2ccba could not be found. {{(pid=120440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 02:16:01.556441 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-bd6a9a33-ac01-40c5-adf1-72a20e8dff7d tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/db657714-7c42-4b17-9954-8ad0a4e2ccba" status: 404 len: 111 microversion: 2.1 time: 0.030441 Sep 16 02:16:01.556441 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 580/1169] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:16:01 2022] GET /compute/v2.1/servers/db657714-7c42-4b17-9954-8ad0a4e2ccba => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 02:16:01.984637 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-ffda47c2-937d-4c7e-b0be-aca17f6a3f2a tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:16:01.985231 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-ffda47c2-937d-4c7e-b0be-aca17f6a3f2a tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: c2851de3-9ab0-467a-8026-5b44a95c5493] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:16:01.992086 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ffda47c2-937d-4c7e-b0be-aca17f6a3f2a tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:16:01.992575 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ffda47c2-937d-4c7e-b0be-aca17f6a3f2a tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:16:01.993020 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ffda47c2-937d-4c7e-b0be-aca17f6a3f2a tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:16:01.994235 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ffda47c2-937d-4c7e-b0be-aca17f6a3f2a tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:16:01.994950 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ffda47c2-937d-4c7e-b0be-aca17f6a3f2a tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:16:01.995379 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ffda47c2-937d-4c7e-b0be-aca17f6a3f2a tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:16:02.008567 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.wsgi [None req-ffda47c2-937d-4c7e-b0be-aca17f6a3f2a tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] HTTP exception thrown: Instance c2851de3-9ab0-467a-8026-5b44a95c5493 could not be found. Sep 16 02:16:02.010871 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-ffda47c2-937d-4c7e-b0be-aca17f6a3f2a tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Request method failure captured: Sep 16 02:16:02.010871 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: request: DELETE /compute/v2.1/servers/c2851de3-9ab0-467a-8026-5b44a95c5493 HTTP/1.1 Sep 16 02:16:02.010871 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Accept: application/json Sep 16 02:16:02.010871 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Accept-Encoding: identity Sep 16 02:16:02.010871 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Connection: close Sep 16 02:16:02.010871 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Content-Length: 0 Sep 16 02:16:02.010871 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Content-Type: application/json Sep 16 02:16:02.010871 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Host: 10.222.0.42 Sep 16 02:16:02.010871 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Openstack-System-Scope: None Sep 16 02:16:02.010871 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: User-Agent: python-urllib3/1.26.12 Sep 16 02:16:02.010871 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Auth-Token: gAAAAABjI9p8TdjH_kwBdldDF3CEs8I-vUyEHyLFI9oJxz2KE9pQ1dnvHn6dUCFQWAJkaiyVsVT2er0HnGWs49wNmoEdAyHHD4Cyp-FSTYX5lE5pMNkeMgCJjSiOjywjN66polzI7ozDE0K2Ot_nthdrnO4uhqOrWK34j169f1muJ7tt4Zo1oh8 Sep 16 02:16:02.010871 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Domain-Id: None Sep 16 02:16:02.010871 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Domain-Name: None Sep 16 02:16:02.010871 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Identity-Status: Confirmed Sep 16 02:16:02.010871 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Is-Admin-Project: True Sep 16 02:16:02.010871 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Domain-Id: default Sep 16 02:16:02.010871 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Domain-Name: Default Sep 16 02:16:02.010871 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Id: 9cfcd2376b1c4398befa49b423aaae26 Sep 16 02:16:02.010871 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Project-Name: tempest-TestVolumeBootPattern-1895408842 Sep 16 02:16:02.010871 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Role: member,reader Sep 16 02:16:02.010871 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Roles: member,reader Sep 16 02:16:02.012646 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9cfcd2376b1c4398befa49b423aaae26"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9cfcd2376b1c4398befa49b423aaae26"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9cfcd2376b1c4398befa49b423aaae26"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9cfcd2376b1c4398befa49b423aaae26"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 02:16:02.012646 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant: tempest-TestVolumeBootPattern-1895408842 Sep 16 02:16:02.012646 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant-Id: 9cfcd2376b1c4398befa49b423aaae26 Sep 16 02:16:02.012646 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-Tenant-Name: tempest-TestVolumeBootPattern-1895408842 Sep 16 02:16:02.012646 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User: tempest-TestVolumeBootPattern-1895408842-project Sep 16 02:16:02.012646 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Domain-Id: default Sep 16 02:16:02.012646 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Domain-Name: Default Sep 16 02:16:02.012646 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Id: 772659a1932d45dea2c5120c4497314b Sep 16 02:16:02.012646 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: X-User-Name: tempest-TestVolumeBootPattern-1895408842-project Sep 16 02:16:02.012646 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: method: > Sep 16 02:16:02.012646 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: exception: Instance c2851de3-9ab0-467a-8026-5b44a95c5493 could not be found. Sep 16 02:16:02.012646 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: action_args: {'id': 'c2851de3-9ab0-467a-8026-5b44a95c5493'} Sep 16 02:16:02.013577 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 02:16:02.013577 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:16:02.013577 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 02:16:02.013577 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 02:16:02.013577 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 02:16:02.013577 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 02:16:02.013577 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 02:16:02.013577 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 02:16:02.013577 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 02:16:02.013577 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 02:16:02.013577 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2851de3-9ab0-467a-8026-5b44a95c5493 could not be found. Sep 16 02:16:02.013577 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:16:02.013577 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:16:02.013577 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:16:02.013577 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:16:02.013577 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:16:02.013577 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:16:02.013577 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 02:16:02.013577 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 02:16:02.013577 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 02:16:02.015184 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 02:16:02.015184 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 02:16:02.015184 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 02:16:02.015184 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 02:16:02.015184 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 02:16:02.015184 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 02:16:02.015184 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 02:16:02.015184 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 02:16:02.015184 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 02:16:02.015184 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2851de3-9ab0-467a-8026-5b44a95c5493 could not be found. Sep 16 02:16:02.015184 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:16:02.015184 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:16:02.015184 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:16:02.015184 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:16:02.015184 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:16:02.015184 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:16:02.015184 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 02:16:02.015184 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 02:16:02.015184 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2851de3-9ab0-467a-8026-5b44a95c5493 could not be found. Sep 16 02:16:02.015184 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR nova.api.openstack.wsgi Sep 16 02:16:02.016875 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-ffda47c2-937d-4c7e-b0be-aca17f6a3f2a tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Returning 404 to user: Instance c2851de3-9ab0-467a-8026-5b44a95c5493 could not be found. {{(pid=120441) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 02:16:02.016875 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-ffda47c2-937d-4c7e-b0be-aca17f6a3f2a tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "DELETE /compute/v2.1/servers/c2851de3-9ab0-467a-8026-5b44a95c5493" status: 404 len: 111 microversion: 2.1 time: 0.031942 Sep 16 02:16:02.016875 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 590/1170] 10.222.0.42 () {58 vars in 1239 bytes} [Fri Sep 16 02:16:01 2022] DELETE /compute/v2.1/servers/c2851de3-9ab0-467a-8026-5b44a95c5493 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 02:16:02.022104 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-326749c2-2823-4adf-9611-6ff48214dd70 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:16:02.022731 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-326749c2-2823-4adf-9611-6ff48214dd70 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] [instance: c2851de3-9ab0-467a-8026-5b44a95c5493] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:16:02.028651 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-326749c2-2823-4adf-9611-6ff48214dd70 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:16:02.029137 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-326749c2-2823-4adf-9611-6ff48214dd70 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:16:02.029576 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-326749c2-2823-4adf-9611-6ff48214dd70 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:16:02.030264 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-326749c2-2823-4adf-9611-6ff48214dd70 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:16:02.030721 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-326749c2-2823-4adf-9611-6ff48214dd70 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:16:02.031148 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-326749c2-2823-4adf-9611-6ff48214dd70 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:16:02.044368 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.wsgi [None req-326749c2-2823-4adf-9611-6ff48214dd70 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] HTTP exception thrown: Instance c2851de3-9ab0-467a-8026-5b44a95c5493 could not be found. Sep 16 02:16:02.045864 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-326749c2-2823-4adf-9611-6ff48214dd70 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Request method failure captured: Sep 16 02:16:02.045864 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: request: GET /compute/v2.1/servers/c2851de3-9ab0-467a-8026-5b44a95c5493 HTTP/1.1 Sep 16 02:16:02.045864 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept: application/json Sep 16 02:16:02.045864 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept-Encoding: identity Sep 16 02:16:02.045864 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Connection: close Sep 16 02:16:02.045864 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Length: 0 Sep 16 02:16:02.045864 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Type: application/json Sep 16 02:16:02.045864 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Host: 10.222.0.42 Sep 16 02:16:02.045864 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Openstack-System-Scope: None Sep 16 02:16:02.045864 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: User-Agent: python-urllib3/1.26.12 Sep 16 02:16:02.045864 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Auth-Token: gAAAAABjI9p8TdjH_kwBdldDF3CEs8I-vUyEHyLFI9oJxz2KE9pQ1dnvHn6dUCFQWAJkaiyVsVT2er0HnGWs49wNmoEdAyHHD4Cyp-FSTYX5lE5pMNkeMgCJjSiOjywjN66polzI7ozDE0K2Ot_nthdrnO4uhqOrWK34j169f1muJ7tt4Zo1oh8 Sep 16 02:16:02.045864 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Id: None Sep 16 02:16:02.045864 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Name: None Sep 16 02:16:02.045864 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Identity-Status: Confirmed Sep 16 02:16:02.045864 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Is-Admin-Project: True Sep 16 02:16:02.045864 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Id: default Sep 16 02:16:02.045864 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Name: Default Sep 16 02:16:02.045864 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Id: 9cfcd2376b1c4398befa49b423aaae26 Sep 16 02:16:02.045864 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Name: tempest-TestVolumeBootPattern-1895408842 Sep 16 02:16:02.045864 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Role: member,reader Sep 16 02:16:02.045864 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Roles: member,reader Sep 16 02:16:02.047571 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/9cfcd2376b1c4398befa49b423aaae26"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9cfcd2376b1c4398befa49b423aaae26"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_9cfcd2376b1c4398befa49b423aaae26"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/9cfcd2376b1c4398befa49b423aaae26"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 02:16:02.047571 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant: tempest-TestVolumeBootPattern-1895408842 Sep 16 02:16:02.047571 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Id: 9cfcd2376b1c4398befa49b423aaae26 Sep 16 02:16:02.047571 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Name: tempest-TestVolumeBootPattern-1895408842 Sep 16 02:16:02.047571 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User: tempest-TestVolumeBootPattern-1895408842-project Sep 16 02:16:02.047571 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Id: default Sep 16 02:16:02.047571 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Name: Default Sep 16 02:16:02.047571 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Id: 772659a1932d45dea2c5120c4497314b Sep 16 02:16:02.047571 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Name: tempest-TestVolumeBootPattern-1895408842-project Sep 16 02:16:02.047571 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: method: > Sep 16 02:16:02.047571 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: exception: Instance c2851de3-9ab0-467a-8026-5b44a95c5493 could not be found. Sep 16 02:16:02.047571 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: action_args: {'id': 'c2851de3-9ab0-467a-8026-5b44a95c5493'} Sep 16 02:16:02.048540 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 02:16:02.048540 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:16:02.048540 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 02:16:02.048540 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 02:16:02.048540 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 02:16:02.048540 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 02:16:02.048540 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 02:16:02.048540 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 02:16:02.048540 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 02:16:02.048540 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 02:16:02.048540 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c2851de3-9ab0-467a-8026-5b44a95c5493 could not be found. Sep 16 02:16:02.048540 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:16:02.048540 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:16:02.048540 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:16:02.048540 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:16:02.048540 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:16:02.048540 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:16:02.048540 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 02:16:02.048540 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 02:16:02.048540 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 02:16:02.050126 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 02:16:02.050126 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 02:16:02.050126 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 02:16:02.050126 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 02:16:02.050126 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 02:16:02.050126 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 02:16:02.050126 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 02:16:02.050126 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c2851de3-9ab0-467a-8026-5b44a95c5493 could not be found. Sep 16 02:16:02.050126 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:16:02.050126 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:16:02.050126 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:16:02.050126 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:16:02.050126 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:16:02.050126 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:16:02.050126 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 02:16:02.050126 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 02:16:02.050126 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c2851de3-9ab0-467a-8026-5b44a95c5493 could not be found. Sep 16 02:16:02.050126 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:16:02.051621 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-326749c2-2823-4adf-9611-6ff48214dd70 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Returning 404 to user: Instance c2851de3-9ab0-467a-8026-5b44a95c5493 could not be found. {{(pid=120440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 02:16:02.051621 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-326749c2-2823-4adf-9611-6ff48214dd70 tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "GET /compute/v2.1/servers/c2851de3-9ab0-467a-8026-5b44a95c5493" status: 404 len: 111 microversion: 2.1 time: 0.028959 Sep 16 02:16:02.051621 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 581/1171] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:16:02 2022] GET /compute/v2.1/servers/c2851de3-9ab0-467a-8026-5b44a95c5493 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 02:16:03.338832 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-f926e180-31f9-4d50-8ec3-863aadc0f04e tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] Calling method '.version_select at 0x7fae32b16310>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:16:03.360432 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-f926e180-31f9-4d50-8ec3-863aadc0f04e tempest-TestVolumeBootPattern-1895408842 tempest-TestVolumeBootPattern-1895408842-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1042516554" status: 202 len: 0 microversion: 2.1 time: 0.025305 Sep 16 02:16:03.361033 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 591/1172] 10.222.0.42 () {58 vars in 1263 bytes} [Fri Sep 16 02:16:03 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1042516554 => generated 0 bytes in 27 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 02:16:45.410598 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-f426679f-7efa-4709-b5ca-c46ae201e683 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:16:45.411224 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-f426679f-7efa-4709-b5ca-c46ae201e683 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] [instance: 4dc692c5-9b00-4551-a5f5-43277c08ba98] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:16:45.413185 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_api:SELECT=18 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:16:45.413812 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell1:SELECT=30 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:16:45.420516 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f426679f-7efa-4709-b5ca-c46ae201e683 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:16:45.420993 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f426679f-7efa-4709-b5ca-c46ae201e683 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:16:45.421422 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f426679f-7efa-4709-b5ca-c46ae201e683 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:16:45.422101 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f426679f-7efa-4709-b5ca-c46ae201e683 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:16:45.422547 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f426679f-7efa-4709-b5ca-c46ae201e683 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:16:45.422965 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-f426679f-7efa-4709-b5ca-c46ae201e683 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:16:45.445330 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.objects.instance [None req-f426679f-7efa-4709-b5ca-c46ae201e683 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lazy-loading 'flavor' on Instance uuid 4dc692c5-9b00-4551-a5f5-43277c08ba98 {{(pid=120440) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 02:16:45.516252 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-f426679f-7efa-4709-b5ca-c46ae201e683 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] 10.222.0.42 "POST /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98/action" status: 202 len: 0 microversion: 2.1 time: 0.109493 Sep 16 02:16:45.516817 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 582/1173] 10.222.0.42 () {60 vars in 1278 bytes} [Fri Sep 16 02:16:45 2022] POST /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98/action => generated 0 bytes in 111 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 02:16:45.525214 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-f9a470a8-213c-4ca4-871f-fd264ef95ae7 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:16:45.525826 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-f9a470a8-213c-4ca4-871f-fd264ef95ae7 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] [instance: 4dc692c5-9b00-4551-a5f5-43277c08ba98] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:16:45.528816 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell1:SELECT=50,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:16:45.529620 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:16:45.537014 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f9a470a8-213c-4ca4-871f-fd264ef95ae7 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:16:45.537514 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f9a470a8-213c-4ca4-871f-fd264ef95ae7 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:16:45.538058 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f9a470a8-213c-4ca4-871f-fd264ef95ae7 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:16:45.538755 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f9a470a8-213c-4ca4-871f-fd264ef95ae7 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:16:45.539206 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f9a470a8-213c-4ca4-871f-fd264ef95ae7 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:16:45.539629 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f9a470a8-213c-4ca4-871f-fd264ef95ae7 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:16:45.675168 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-f9a470a8-213c-4ca4-871f-fd264ef95ae7 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3333a4ba4204c80ac03c960bfb77ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bf0e348b4944e8907b80446a12a6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:16:45.682857 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-f9a470a8-213c-4ca4-871f-fd264ef95ae7 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] 10.222.0.42 "GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98" status: 200 len: 1566 microversion: 2.1 time: 0.161712 Sep 16 02:16:45.683418 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 592/1174] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:16:45 2022] GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:16:46.708197 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-a13175a0-eb0c-4d4e-bbbf-f755c0c90253 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:16:46.708893 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-a13175a0-eb0c-4d4e-bbbf-f755c0c90253 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] [instance: 4dc692c5-9b00-4551-a5f5-43277c08ba98] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:16:46.715826 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a13175a0-eb0c-4d4e-bbbf-f755c0c90253 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:16:46.716334 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a13175a0-eb0c-4d4e-bbbf-f755c0c90253 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:16:46.716764 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a13175a0-eb0c-4d4e-bbbf-f755c0c90253 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:16:46.717439 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a13175a0-eb0c-4d4e-bbbf-f755c0c90253 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:16:46.717884 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a13175a0-eb0c-4d4e-bbbf-f755c0c90253 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:16:46.718302 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a13175a0-eb0c-4d4e-bbbf-f755c0c90253 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:16:46.848941 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-a13175a0-eb0c-4d4e-bbbf-f755c0c90253 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3333a4ba4204c80ac03c960bfb77ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bf0e348b4944e8907b80446a12a6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:16:46.857400 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-a13175a0-eb0c-4d4e-bbbf-f755c0c90253 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] 10.222.0.42 "GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98" status: 200 len: 1566 microversion: 2.1 time: 0.153909 Sep 16 02:16:46.857958 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 583/1175] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:16:46 2022] GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:16:47.880514 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-25f4cf87-2282-4d10-882d-696314533aa7 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:16:47.881163 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-25f4cf87-2282-4d10-882d-696314533aa7 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] [instance: 4dc692c5-9b00-4551-a5f5-43277c08ba98] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:16:47.887587 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-25f4cf87-2282-4d10-882d-696314533aa7 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:16:47.888105 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-25f4cf87-2282-4d10-882d-696314533aa7 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:16:47.888545 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-25f4cf87-2282-4d10-882d-696314533aa7 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:16:47.889233 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-25f4cf87-2282-4d10-882d-696314533aa7 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:16:47.889688 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-25f4cf87-2282-4d10-882d-696314533aa7 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:16:47.890118 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-25f4cf87-2282-4d10-882d-696314533aa7 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:16:48.017988 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-25f4cf87-2282-4d10-882d-696314533aa7 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3333a4ba4204c80ac03c960bfb77ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bf0e348b4944e8907b80446a12a6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:16:48.025555 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-25f4cf87-2282-4d10-882d-696314533aa7 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] 10.222.0.42 "GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98" status: 200 len: 1566 microversion: 2.1 time: 0.148916 Sep 16 02:16:48.026148 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 593/1176] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:16:47 2022] GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98 => generated 1566 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:16:49.048667 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-91cfb1f3-c160-4804-a943-51ce541c4095 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:16:49.049285 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-91cfb1f3-c160-4804-a943-51ce541c4095 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] [instance: 4dc692c5-9b00-4551-a5f5-43277c08ba98] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:16:49.055610 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-91cfb1f3-c160-4804-a943-51ce541c4095 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:16:49.056133 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-91cfb1f3-c160-4804-a943-51ce541c4095 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:16:49.056578 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-91cfb1f3-c160-4804-a943-51ce541c4095 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:16:49.057267 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-91cfb1f3-c160-4804-a943-51ce541c4095 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:16:49.057721 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-91cfb1f3-c160-4804-a943-51ce541c4095 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:16:49.058148 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-91cfb1f3-c160-4804-a943-51ce541c4095 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:16:49.193106 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-91cfb1f3-c160-4804-a943-51ce541c4095 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3333a4ba4204c80ac03c960bfb77ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bf0e348b4944e8907b80446a12a6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:16:49.200855 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-91cfb1f3-c160-4804-a943-51ce541c4095 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] 10.222.0.42 "GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98" status: 200 len: 1566 microversion: 2.1 time: 0.156075 Sep 16 02:16:49.201417 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 584/1177] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:16:49 2022] GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98 => generated 1566 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:16:50.225309 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-b1f7557c-ea6c-4ce0-ae0b-29d47b2edb1b tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:16:50.225926 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-b1f7557c-ea6c-4ce0-ae0b-29d47b2edb1b tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] [instance: 4dc692c5-9b00-4551-a5f5-43277c08ba98] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:16:50.232940 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b1f7557c-ea6c-4ce0-ae0b-29d47b2edb1b tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:16:50.233427 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b1f7557c-ea6c-4ce0-ae0b-29d47b2edb1b tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:16:50.233862 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b1f7557c-ea6c-4ce0-ae0b-29d47b2edb1b tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:16:50.234547 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b1f7557c-ea6c-4ce0-ae0b-29d47b2edb1b tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:16:50.234998 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b1f7557c-ea6c-4ce0-ae0b-29d47b2edb1b tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:16:50.235422 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-b1f7557c-ea6c-4ce0-ae0b-29d47b2edb1b tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:16:50.367556 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-b1f7557c-ea6c-4ce0-ae0b-29d47b2edb1b tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3333a4ba4204c80ac03c960bfb77ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bf0e348b4944e8907b80446a12a6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:16:50.376264 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-b1f7557c-ea6c-4ce0-ae0b-29d47b2edb1b tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] 10.222.0.42 "GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98" status: 200 len: 1566 microversion: 2.1 time: 0.154884 Sep 16 02:16:50.376826 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 594/1178] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:16:50 2022] GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98 => generated 1566 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:16:51.400453 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-0ce6e353-42f2-4054-986e-b0a8df8c4999 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:16:51.401062 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-0ce6e353-42f2-4054-986e-b0a8df8c4999 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] [instance: 4dc692c5-9b00-4551-a5f5-43277c08ba98] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:16:51.407584 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0ce6e353-42f2-4054-986e-b0a8df8c4999 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:16:51.408101 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0ce6e353-42f2-4054-986e-b0a8df8c4999 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:16:51.408539 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0ce6e353-42f2-4054-986e-b0a8df8c4999 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:16:51.409226 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0ce6e353-42f2-4054-986e-b0a8df8c4999 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:16:51.409674 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0ce6e353-42f2-4054-986e-b0a8df8c4999 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:16:51.410102 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-0ce6e353-42f2-4054-986e-b0a8df8c4999 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:16:51.538841 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-0ce6e353-42f2-4054-986e-b0a8df8c4999 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3333a4ba4204c80ac03c960bfb77ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bf0e348b4944e8907b80446a12a6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:16:51.547082 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-0ce6e353-42f2-4054-986e-b0a8df8c4999 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] 10.222.0.42 "GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98" status: 200 len: 1566 microversion: 2.1 time: 0.150444 Sep 16 02:16:51.547656 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 585/1179] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:16:51 2022] GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:16:52.571478 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-f3c4e60b-3d9c-4c1a-a9de-c34a8a956a4f tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:16:52.572047 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-f3c4e60b-3d9c-4c1a-a9de-c34a8a956a4f tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] [instance: 4dc692c5-9b00-4551-a5f5-43277c08ba98] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:16:52.579162 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f3c4e60b-3d9c-4c1a-a9de-c34a8a956a4f tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:16:52.579647 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f3c4e60b-3d9c-4c1a-a9de-c34a8a956a4f tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:16:52.580122 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f3c4e60b-3d9c-4c1a-a9de-c34a8a956a4f tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:16:52.580812 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f3c4e60b-3d9c-4c1a-a9de-c34a8a956a4f tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:16:52.581264 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f3c4e60b-3d9c-4c1a-a9de-c34a8a956a4f tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:16:52.581686 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-f3c4e60b-3d9c-4c1a-a9de-c34a8a956a4f tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:16:52.711535 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-f3c4e60b-3d9c-4c1a-a9de-c34a8a956a4f tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3333a4ba4204c80ac03c960bfb77ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bf0e348b4944e8907b80446a12a6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:16:52.719412 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-f3c4e60b-3d9c-4c1a-a9de-c34a8a956a4f tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] 10.222.0.42 "GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98" status: 200 len: 1566 microversion: 2.1 time: 0.151865 Sep 16 02:16:52.719986 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 595/1180] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:16:52 2022] GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:16:53.742630 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-6d50bee4-16b6-4e5a-a2ab-c5bbae64b4ff tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:16:53.743249 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-6d50bee4-16b6-4e5a-a2ab-c5bbae64b4ff tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] [instance: 4dc692c5-9b00-4551-a5f5-43277c08ba98] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:16:53.750251 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6d50bee4-16b6-4e5a-a2ab-c5bbae64b4ff tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:16:53.750736 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6d50bee4-16b6-4e5a-a2ab-c5bbae64b4ff tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:16:53.751174 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6d50bee4-16b6-4e5a-a2ab-c5bbae64b4ff tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:16:53.751863 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6d50bee4-16b6-4e5a-a2ab-c5bbae64b4ff tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:16:53.752346 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6d50bee4-16b6-4e5a-a2ab-c5bbae64b4ff tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:16:53.752775 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6d50bee4-16b6-4e5a-a2ab-c5bbae64b4ff tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:16:53.881198 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-6d50bee4-16b6-4e5a-a2ab-c5bbae64b4ff tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3333a4ba4204c80ac03c960bfb77ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bf0e348b4944e8907b80446a12a6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:16:53.889463 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-6d50bee4-16b6-4e5a-a2ab-c5bbae64b4ff tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] 10.222.0.42 "GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98" status: 200 len: 1566 microversion: 2.1 time: 0.150743 Sep 16 02:16:53.890024 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 586/1181] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:16:53 2022] GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98 => generated 1566 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:16:54.912891 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-7165718a-1238-41d4-9985-4ffe37e217a1 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:16:54.913505 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-7165718a-1238-41d4-9985-4ffe37e217a1 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] [instance: 4dc692c5-9b00-4551-a5f5-43277c08ba98] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:16:54.920223 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7165718a-1238-41d4-9985-4ffe37e217a1 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:16:54.920705 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7165718a-1238-41d4-9985-4ffe37e217a1 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:16:54.921139 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7165718a-1238-41d4-9985-4ffe37e217a1 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:16:54.921819 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7165718a-1238-41d4-9985-4ffe37e217a1 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:16:54.922279 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7165718a-1238-41d4-9985-4ffe37e217a1 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:16:54.922702 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-7165718a-1238-41d4-9985-4ffe37e217a1 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:16:55.054591 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-7165718a-1238-41d4-9985-4ffe37e217a1 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3333a4ba4204c80ac03c960bfb77ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bf0e348b4944e8907b80446a12a6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:16:55.063006 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-7165718a-1238-41d4-9985-4ffe37e217a1 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] 10.222.0.42 "GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98" status: 200 len: 1566 microversion: 2.1 time: 0.153927 Sep 16 02:16:55.063515 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 596/1182] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:16:54 2022] GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98 => generated 1566 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:16:56.086671 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-cd34a431-c4dc-4d6e-8750-159bf100e170 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:16:56.087520 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-cd34a431-c4dc-4d6e-8750-159bf100e170 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] [instance: 4dc692c5-9b00-4551-a5f5-43277c08ba98] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:16:56.094512 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cd34a431-c4dc-4d6e-8750-159bf100e170 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:16:56.094992 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cd34a431-c4dc-4d6e-8750-159bf100e170 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:16:56.095422 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cd34a431-c4dc-4d6e-8750-159bf100e170 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:16:56.096139 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cd34a431-c4dc-4d6e-8750-159bf100e170 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:16:56.096588 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cd34a431-c4dc-4d6e-8750-159bf100e170 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:16:56.097002 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cd34a431-c4dc-4d6e-8750-159bf100e170 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:16:56.450966 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-cd34a431-c4dc-4d6e-8750-159bf100e170 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3333a4ba4204c80ac03c960bfb77ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bf0e348b4944e8907b80446a12a6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:16:56.458713 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-cd34a431-c4dc-4d6e-8750-159bf100e170 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] 10.222.0.42 "GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98" status: 200 len: 1566 microversion: 2.1 time: 0.375928 Sep 16 02:16:56.459309 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 587/1183] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:16:56 2022] GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98 => generated 1566 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:16:57.482969 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-1cbc1709-e885-470c-84a3-968336d69eeb tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:16:57.483561 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-1cbc1709-e885-470c-84a3-968336d69eeb tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] [instance: 4dc692c5-9b00-4551-a5f5-43277c08ba98] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:16:57.490183 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1cbc1709-e885-470c-84a3-968336d69eeb tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:16:57.490664 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1cbc1709-e885-470c-84a3-968336d69eeb tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:16:57.491094 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1cbc1709-e885-470c-84a3-968336d69eeb tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:16:57.491775 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1cbc1709-e885-470c-84a3-968336d69eeb tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:16:57.492247 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1cbc1709-e885-470c-84a3-968336d69eeb tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:16:57.492668 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-1cbc1709-e885-470c-84a3-968336d69eeb tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:16:57.623006 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-1cbc1709-e885-470c-84a3-968336d69eeb tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3333a4ba4204c80ac03c960bfb77ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bf0e348b4944e8907b80446a12a6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:16:57.630631 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-1cbc1709-e885-470c-84a3-968336d69eeb tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] 10.222.0.42 "GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98" status: 200 len: 1566 microversion: 2.1 time: 0.151635 Sep 16 02:16:57.631198 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 597/1184] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:16:57 2022] GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98 => generated 1566 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:16:58.654377 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-2cf580fa-806c-40f3-b500-6567c93d0615 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:16:58.654999 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-2cf580fa-806c-40f3-b500-6567c93d0615 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] [instance: 4dc692c5-9b00-4551-a5f5-43277c08ba98] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:16:58.661500 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2cf580fa-806c-40f3-b500-6567c93d0615 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:16:58.661988 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2cf580fa-806c-40f3-b500-6567c93d0615 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:16:58.662421 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2cf580fa-806c-40f3-b500-6567c93d0615 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:16:58.663102 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2cf580fa-806c-40f3-b500-6567c93d0615 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:16:58.663548 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2cf580fa-806c-40f3-b500-6567c93d0615 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:16:58.663997 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-2cf580fa-806c-40f3-b500-6567c93d0615 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:16:58.819579 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-2cf580fa-806c-40f3-b500-6567c93d0615 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3333a4ba4204c80ac03c960bfb77ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bf0e348b4944e8907b80446a12a6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:16:58.831229 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-2cf580fa-806c-40f3-b500-6567c93d0615 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] 10.222.0.42 "GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98" status: 200 len: 1567 microversion: 2.1 time: 0.181476 Sep 16 02:16:58.832229 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 588/1185] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:16:58 2022] GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98 => generated 1567 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:16:58.854966 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-709ca418-15ab-4417-a315-1cb0b44e5365 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:16:58.855571 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-709ca418-15ab-4417-a315-1cb0b44e5365 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] [instance: 4dc692c5-9b00-4551-a5f5-43277c08ba98] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:16:58.863553 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-709ca418-15ab-4417-a315-1cb0b44e5365 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:16:58.864097 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-709ca418-15ab-4417-a315-1cb0b44e5365 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:16:58.864532 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-709ca418-15ab-4417-a315-1cb0b44e5365 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:16:58.865232 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-709ca418-15ab-4417-a315-1cb0b44e5365 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:16:58.865686 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-709ca418-15ab-4417-a315-1cb0b44e5365 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:16:58.866111 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-709ca418-15ab-4417-a315-1cb0b44e5365 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:16:58.915521 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-709ca418-15ab-4417-a315-1cb0b44e5365 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] [instance: 4dc692c5-9b00-4551-a5f5-43277c08ba98] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=120441) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 16 02:16:58.993265 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: ERROR oslo.messaging._drivers.impl_rabbit [None req-709ca418-15ab-4417-a315-1cb0b44e5365 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] [723ac166-f4d5-44e0-8683-6ec76c826db4] AMQP server on 10.222.0.42:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 16 02:17:00.001596 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO oslo.messaging._drivers.impl_rabbit [None req-709ca418-15ab-4417-a315-1cb0b44e5365 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] [723ac166-f4d5-44e0-8683-6ec76c826db4] Reconnected to AMQP server on 10.222.0.42:5672 via [amqp] client with port 40524. Sep 16 02:17:00.004707 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-709ca418-15ab-4417-a315-1cb0b44e5365 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] 10.222.0.42 "POST /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98/action" status: 202 len: 0 microversion: 2.1 time: 1.153780 Sep 16 02:17:00.005313 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 598/1186] 10.222.0.42 () {60 vars in 1278 bytes} [Fri Sep 16 02:16:58 2022] POST /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98/action => generated 0 bytes in 1155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 02:17:00.013671 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-a4de2faa-b5bf-4c65-b348-d51ce2272a71 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:17:00.014280 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-a4de2faa-b5bf-4c65-b348-d51ce2272a71 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] [instance: 4dc692c5-9b00-4551-a5f5-43277c08ba98] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:17:00.020831 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a4de2faa-b5bf-4c65-b348-d51ce2272a71 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:17:00.021306 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a4de2faa-b5bf-4c65-b348-d51ce2272a71 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:17:00.021740 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a4de2faa-b5bf-4c65-b348-d51ce2272a71 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:17:00.022423 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a4de2faa-b5bf-4c65-b348-d51ce2272a71 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:17:00.022867 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a4de2faa-b5bf-4c65-b348-d51ce2272a71 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:17:00.023287 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a4de2faa-b5bf-4c65-b348-d51ce2272a71 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:17:00.161456 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-a4de2faa-b5bf-4c65-b348-d51ce2272a71 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3333a4ba4204c80ac03c960bfb77ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bf0e348b4944e8907b80446a12a6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:17:00.170845 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-a4de2faa-b5bf-4c65-b348-d51ce2272a71 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] 10.222.0.42 "GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98" status: 200 len: 1515 microversion: 2.1 time: 0.161267 Sep 16 02:17:00.171740 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 589/1187] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:17:00 2022] GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98 => generated 1515 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 02:17:01.194602 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-6b18b45f-7b71-41b4-95ca-03bbfc87ca03 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:17:01.195198 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-6b18b45f-7b71-41b4-95ca-03bbfc87ca03 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] [instance: 4dc692c5-9b00-4551-a5f5-43277c08ba98] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:17:01.202396 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-6b18b45f-7b71-41b4-95ca-03bbfc87ca03 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:17:01.202872 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-6b18b45f-7b71-41b4-95ca-03bbfc87ca03 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:17:01.203335 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-6b18b45f-7b71-41b4-95ca-03bbfc87ca03 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:17:01.204113 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-6b18b45f-7b71-41b4-95ca-03bbfc87ca03 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:17:01.204566 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-6b18b45f-7b71-41b4-95ca-03bbfc87ca03 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:17:01.204990 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-6b18b45f-7b71-41b4-95ca-03bbfc87ca03 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:17:01.337000 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-6b18b45f-7b71-41b4-95ca-03bbfc87ca03 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3333a4ba4204c80ac03c960bfb77ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bf0e348b4944e8907b80446a12a6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:17:01.346556 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-6b18b45f-7b71-41b4-95ca-03bbfc87ca03 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] 10.222.0.42 "GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98" status: 200 len: 1517 microversion: 2.1 time: 0.156355 Sep 16 02:17:01.347362 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 599/1188] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:17:01 2022] GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98 => generated 1517 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 02:17:01.620230 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [req-ac43e9c8-c24c-43e9-985f-27b2ca15e0c6 req-106c92ef-5d12-4f68-897a-d75e52d14cb9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dc692c5-9b00-4551-a5f5-43277c08ba98", "name": "network-vif-unplugged", "status": "completed", "tag": "4c2f2ad7-8720-4f8e-9294-ca860089689f"}]} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:17:01.631244 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-ac43e9c8-c24c-43e9-985f-27b2ca15e0c6 req-106c92ef-5d12-4f68-897a-d75e52d14cb9 service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:17:01.631730 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-ac43e9c8-c24c-43e9-985f-27b2ca15e0c6 req-106c92ef-5d12-4f68-897a-d75e52d14cb9 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:17:01.632220 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-ac43e9c8-c24c-43e9-985f-27b2ca15e0c6 req-106c92ef-5d12-4f68-897a-d75e52d14cb9 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:17:01.644751 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.compute.server_external_events [req-ac43e9c8-c24c-43e9-985f-27b2ca15e0c6 req-106c92ef-5d12-4f68-897a-d75e52d14cb9 service nova] Creating event network-vif-unplugged:4c2f2ad7-8720-4f8e-9294-ca860089689f for instance 4dc692c5-9b00-4551-a5f5-43277c08ba98 on hv-cinder-84914 Sep 16 02:17:01.650316 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [req-ac43e9c8-c24c-43e9-985f-27b2ca15e0c6 req-106c92ef-5d12-4f68-897a-d75e52d14cb9 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.104732 Sep 16 02:17:01.650904 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 590/1189] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:17:01 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 106 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 02:17:02.370854 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-5e14f9f2-d9d4-47e0-af0f-411156fbd66f tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:17:02.372280 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-5e14f9f2-d9d4-47e0-af0f-411156fbd66f tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] [instance: 4dc692c5-9b00-4551-a5f5-43277c08ba98] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:17:02.378426 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5e14f9f2-d9d4-47e0-af0f-411156fbd66f tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:17:02.378909 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5e14f9f2-d9d4-47e0-af0f-411156fbd66f tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:17:02.379342 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5e14f9f2-d9d4-47e0-af0f-411156fbd66f tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:17:02.380066 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5e14f9f2-d9d4-47e0-af0f-411156fbd66f tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:17:02.380519 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5e14f9f2-d9d4-47e0-af0f-411156fbd66f tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:17:02.380941 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5e14f9f2-d9d4-47e0-af0f-411156fbd66f tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:17:02.821594 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-5e14f9f2-d9d4-47e0-af0f-411156fbd66f tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3333a4ba4204c80ac03c960bfb77ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bf0e348b4944e8907b80446a12a6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:17:02.832120 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-5e14f9f2-d9d4-47e0-af0f-411156fbd66f tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] 10.222.0.42 "GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98" status: 200 len: 1573 microversion: 2.1 time: 0.465449 Sep 16 02:17:02.832689 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 600/1190] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:17:02 2022] GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98 => generated 1573 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:17:03.857643 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-6184d76c-fa77-4d92-95a3-56fb56684434 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:17:03.858340 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-6184d76c-fa77-4d92-95a3-56fb56684434 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] [instance: 4dc692c5-9b00-4551-a5f5-43277c08ba98] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:17:03.864491 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6184d76c-fa77-4d92-95a3-56fb56684434 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:17:03.864976 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6184d76c-fa77-4d92-95a3-56fb56684434 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:17:03.865411 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6184d76c-fa77-4d92-95a3-56fb56684434 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:17:03.866128 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6184d76c-fa77-4d92-95a3-56fb56684434 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:17:03.866581 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6184d76c-fa77-4d92-95a3-56fb56684434 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:17:03.867003 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-6184d76c-fa77-4d92-95a3-56fb56684434 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:17:03.994802 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-6184d76c-fa77-4d92-95a3-56fb56684434 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3333a4ba4204c80ac03c960bfb77ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bf0e348b4944e8907b80446a12a6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:17:04.003121 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-6184d76c-fa77-4d92-95a3-56fb56684434 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] 10.222.0.42 "GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98" status: 200 len: 1573 microversion: 2.1 time: 0.150814 Sep 16 02:17:04.003688 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 591/1191] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:17:03 2022] GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98 => generated 1573 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:17:05.026661 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-8b4e3521-a6ff-4157-b84f-740ebd6732f7 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:17:05.027891 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-8b4e3521-a6ff-4157-b84f-740ebd6732f7 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] [instance: 4dc692c5-9b00-4551-a5f5-43277c08ba98] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:17:05.034574 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8b4e3521-a6ff-4157-b84f-740ebd6732f7 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:17:05.035060 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8b4e3521-a6ff-4157-b84f-740ebd6732f7 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:17:05.035503 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8b4e3521-a6ff-4157-b84f-740ebd6732f7 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:17:05.036223 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8b4e3521-a6ff-4157-b84f-740ebd6732f7 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:17:05.036679 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8b4e3521-a6ff-4157-b84f-740ebd6732f7 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:17:05.037107 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8b4e3521-a6ff-4157-b84f-740ebd6732f7 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:17:05.172133 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-8b4e3521-a6ff-4157-b84f-740ebd6732f7 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3333a4ba4204c80ac03c960bfb77ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bf0e348b4944e8907b80446a12a6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:17:05.179712 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-8b4e3521-a6ff-4157-b84f-740ebd6732f7 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] 10.222.0.42 "GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98" status: 200 len: 1573 microversion: 2.1 time: 0.157016 Sep 16 02:17:05.180305 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 601/1192] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:17:05 2022] GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98 => generated 1573 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:17:06.203878 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-eb4e59c3-82f8-4392-a5d9-3d66d892e7c6 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:17:06.204509 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-eb4e59c3-82f8-4392-a5d9-3d66d892e7c6 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] [instance: 4dc692c5-9b00-4551-a5f5-43277c08ba98] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:17:06.210893 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-eb4e59c3-82f8-4392-a5d9-3d66d892e7c6 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:17:06.211375 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-eb4e59c3-82f8-4392-a5d9-3d66d892e7c6 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:17:06.211806 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-eb4e59c3-82f8-4392-a5d9-3d66d892e7c6 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:17:06.212509 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-eb4e59c3-82f8-4392-a5d9-3d66d892e7c6 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:17:06.212957 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-eb4e59c3-82f8-4392-a5d9-3d66d892e7c6 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:17:06.213376 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-eb4e59c3-82f8-4392-a5d9-3d66d892e7c6 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:17:06.345837 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-eb4e59c3-82f8-4392-a5d9-3d66d892e7c6 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3333a4ba4204c80ac03c960bfb77ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bf0e348b4944e8907b80446a12a6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:17:06.353488 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-eb4e59c3-82f8-4392-a5d9-3d66d892e7c6 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] 10.222.0.42 "GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98" status: 200 len: 1573 microversion: 2.1 time: 0.154111 Sep 16 02:17:06.354053 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 592/1193] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:17:06 2022] GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98 => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:17:07.376687 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-ccc2ce9d-d8c2-4774-8187-dca245275227 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:17:07.377299 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-ccc2ce9d-d8c2-4774-8187-dca245275227 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] [instance: 4dc692c5-9b00-4551-a5f5-43277c08ba98] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:17:07.383581 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ccc2ce9d-d8c2-4774-8187-dca245275227 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:17:07.384096 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ccc2ce9d-d8c2-4774-8187-dca245275227 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:17:07.384531 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ccc2ce9d-d8c2-4774-8187-dca245275227 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:17:07.385220 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ccc2ce9d-d8c2-4774-8187-dca245275227 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:17:07.385665 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ccc2ce9d-d8c2-4774-8187-dca245275227 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:17:07.386087 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-ccc2ce9d-d8c2-4774-8187-dca245275227 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:17:07.521468 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-ccc2ce9d-d8c2-4774-8187-dca245275227 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3333a4ba4204c80ac03c960bfb77ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bf0e348b4944e8907b80446a12a6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:17:07.531355 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-ccc2ce9d-d8c2-4774-8187-dca245275227 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] 10.222.0.42 "GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98" status: 200 len: 1573 microversion: 2.1 time: 0.158554 Sep 16 02:17:07.531913 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 602/1194] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:17:07 2022] GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98 => generated 1573 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:17:08.554556 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-7b2a7360-5680-4104-924b-6642e63b3c8e tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:17:08.555161 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-7b2a7360-5680-4104-924b-6642e63b3c8e tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] [instance: 4dc692c5-9b00-4551-a5f5-43277c08ba98] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:17:08.562152 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7b2a7360-5680-4104-924b-6642e63b3c8e tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:17:08.562582 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7b2a7360-5680-4104-924b-6642e63b3c8e tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:17:08.563014 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7b2a7360-5680-4104-924b-6642e63b3c8e tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:17:08.563693 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7b2a7360-5680-4104-924b-6642e63b3c8e tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:17:08.564171 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7b2a7360-5680-4104-924b-6642e63b3c8e tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:17:08.564594 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-7b2a7360-5680-4104-924b-6642e63b3c8e tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:17:08.691872 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-7b2a7360-5680-4104-924b-6642e63b3c8e tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3333a4ba4204c80ac03c960bfb77ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bf0e348b4944e8907b80446a12a6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:17:08.700223 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-7b2a7360-5680-4104-924b-6642e63b3c8e tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] 10.222.0.42 "GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98" status: 200 len: 1573 microversion: 2.1 time: 0.149499 Sep 16 02:17:08.700820 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 593/1195] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:17:08 2022] GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98 => generated 1573 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:17:09.723301 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-e2e63b31-754c-4b72-b78f-587341a05dd9 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:17:09.723878 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-e2e63b31-754c-4b72-b78f-587341a05dd9 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] [instance: 4dc692c5-9b00-4551-a5f5-43277c08ba98] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:17:09.730440 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e2e63b31-754c-4b72-b78f-587341a05dd9 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:17:09.731057 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e2e63b31-754c-4b72-b78f-587341a05dd9 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:17:09.731520 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e2e63b31-754c-4b72-b78f-587341a05dd9 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:17:09.732232 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e2e63b31-754c-4b72-b78f-587341a05dd9 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:17:09.732686 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e2e63b31-754c-4b72-b78f-587341a05dd9 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:17:09.733111 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-e2e63b31-754c-4b72-b78f-587341a05dd9 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:17:09.861617 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-e2e63b31-754c-4b72-b78f-587341a05dd9 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3333a4ba4204c80ac03c960bfb77ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bf0e348b4944e8907b80446a12a6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:17:09.869561 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-e2e63b31-754c-4b72-b78f-587341a05dd9 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] 10.222.0.42 "GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98" status: 200 len: 1573 microversion: 2.1 time: 0.149905 Sep 16 02:17:09.870116 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 603/1196] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:17:09 2022] GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98 => generated 1573 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:17:10.892890 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-a259fd74-3c6e-4c1e-afef-24307cbc7df4 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:17:10.893512 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-a259fd74-3c6e-4c1e-afef-24307cbc7df4 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] [instance: 4dc692c5-9b00-4551-a5f5-43277c08ba98] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:17:10.899559 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a259fd74-3c6e-4c1e-afef-24307cbc7df4 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:17:10.900080 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a259fd74-3c6e-4c1e-afef-24307cbc7df4 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:17:10.900526 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a259fd74-3c6e-4c1e-afef-24307cbc7df4 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:17:10.901214 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a259fd74-3c6e-4c1e-afef-24307cbc7df4 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:17:10.901673 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a259fd74-3c6e-4c1e-afef-24307cbc7df4 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:17:10.902097 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-a259fd74-3c6e-4c1e-afef-24307cbc7df4 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:17:11.029784 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-a259fd74-3c6e-4c1e-afef-24307cbc7df4 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3333a4ba4204c80ac03c960bfb77ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bf0e348b4944e8907b80446a12a6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:17:11.037412 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-a259fd74-3c6e-4c1e-afef-24307cbc7df4 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] 10.222.0.42 "GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98" status: 200 len: 1573 microversion: 2.1 time: 0.148363 Sep 16 02:17:11.037976 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 594/1197] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:17:10 2022] GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98 => generated 1573 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:17:12.060908 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-8743a8a4-94a4-4174-9827-0ed10adb4649 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:17:12.061521 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-8743a8a4-94a4-4174-9827-0ed10adb4649 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] [instance: 4dc692c5-9b00-4551-a5f5-43277c08ba98] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:17:12.067966 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8743a8a4-94a4-4174-9827-0ed10adb4649 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:17:12.068449 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8743a8a4-94a4-4174-9827-0ed10adb4649 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:17:12.068882 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8743a8a4-94a4-4174-9827-0ed10adb4649 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:17:12.069569 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8743a8a4-94a4-4174-9827-0ed10adb4649 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:17:12.070017 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8743a8a4-94a4-4174-9827-0ed10adb4649 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:17:12.070439 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-8743a8a4-94a4-4174-9827-0ed10adb4649 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:17:12.201240 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-8743a8a4-94a4-4174-9827-0ed10adb4649 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3333a4ba4204c80ac03c960bfb77ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bf0e348b4944e8907b80446a12a6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:17:12.208820 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-8743a8a4-94a4-4174-9827-0ed10adb4649 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] 10.222.0.42 "GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98" status: 200 len: 1573 microversion: 2.1 time: 0.152537 Sep 16 02:17:12.209388 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 604/1198] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:17:12 2022] GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98 => generated 1573 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:17:13.232931 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-893ded60-2b3c-467e-90bf-9c1a9d126ba8 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:17:13.233606 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-893ded60-2b3c-467e-90bf-9c1a9d126ba8 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] [instance: 4dc692c5-9b00-4551-a5f5-43277c08ba98] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:17:13.239953 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-893ded60-2b3c-467e-90bf-9c1a9d126ba8 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:17:13.240439 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-893ded60-2b3c-467e-90bf-9c1a9d126ba8 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:17:13.240875 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-893ded60-2b3c-467e-90bf-9c1a9d126ba8 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:17:13.241556 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-893ded60-2b3c-467e-90bf-9c1a9d126ba8 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:17:13.242008 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-893ded60-2b3c-467e-90bf-9c1a9d126ba8 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:17:13.242433 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-893ded60-2b3c-467e-90bf-9c1a9d126ba8 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:17:13.376174 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-893ded60-2b3c-467e-90bf-9c1a9d126ba8 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3333a4ba4204c80ac03c960bfb77ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bf0e348b4944e8907b80446a12a6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:17:13.383758 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-893ded60-2b3c-467e-90bf-9c1a9d126ba8 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] 10.222.0.42 "GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98" status: 200 len: 1573 microversion: 2.1 time: 0.155472 Sep 16 02:17:13.384360 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 595/1199] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:17:13 2022] GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98 => generated 1573 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:17:13.661569 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [req-c078167c-bb23-4e5e-b665-ea5e36ec1b63 req-341288b9-50af-45de-b48d-6fac29489cfc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dc692c5-9b00-4551-a5f5-43277c08ba98", "name": "network-vif-plugged", "status": "completed", "tag": "4c2f2ad7-8720-4f8e-9294-ca860089689f"}]} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:17:13.672971 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-c078167c-bb23-4e5e-b665-ea5e36ec1b63 req-341288b9-50af-45de-b48d-6fac29489cfc service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:17:13.673445 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-c078167c-bb23-4e5e-b665-ea5e36ec1b63 req-341288b9-50af-45de-b48d-6fac29489cfc service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:17:13.673927 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-c078167c-bb23-4e5e-b665-ea5e36ec1b63 req-341288b9-50af-45de-b48d-6fac29489cfc service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:17:13.685196 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.compute.server_external_events [req-c078167c-bb23-4e5e-b665-ea5e36ec1b63 req-341288b9-50af-45de-b48d-6fac29489cfc service nova] Creating event network-vif-plugged:4c2f2ad7-8720-4f8e-9294-ca860089689f for instance 4dc692c5-9b00-4551-a5f5-43277c08ba98 on hv-cinder-84914 Sep 16 02:17:13.690247 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [req-c078167c-bb23-4e5e-b665-ea5e36ec1b63 req-341288b9-50af-45de-b48d-6fac29489cfc service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032379 Sep 16 02:17:13.690841 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 605/1200] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:17:14.409113 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-ed6fc09c-4da9-4f9d-9480-de5ac34aa214 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:17:14.409730 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-ed6fc09c-4da9-4f9d-9480-de5ac34aa214 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] [instance: 4dc692c5-9b00-4551-a5f5-43277c08ba98] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:17:14.416082 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ed6fc09c-4da9-4f9d-9480-de5ac34aa214 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:17:14.416570 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ed6fc09c-4da9-4f9d-9480-de5ac34aa214 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:17:14.417010 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ed6fc09c-4da9-4f9d-9480-de5ac34aa214 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:17:14.418355 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ed6fc09c-4da9-4f9d-9480-de5ac34aa214 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:17:14.418938 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ed6fc09c-4da9-4f9d-9480-de5ac34aa214 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:17:14.419370 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-ed6fc09c-4da9-4f9d-9480-de5ac34aa214 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:17:14.549990 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-ed6fc09c-4da9-4f9d-9480-de5ac34aa214 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3333a4ba4204c80ac03c960bfb77ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bf0e348b4944e8907b80446a12a6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:17:14.557544 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-ed6fc09c-4da9-4f9d-9480-de5ac34aa214 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] 10.222.0.42 "GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98" status: 200 len: 1573 microversion: 2.1 time: 0.153381 Sep 16 02:17:14.558662 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 596/1201] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:17:14 2022] GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98 => generated 1573 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:17:15.581962 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-fab57b2b-fb69-468d-832a-227c4133afad tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:17:15.582654 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-fab57b2b-fb69-468d-832a-227c4133afad tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] [instance: 4dc692c5-9b00-4551-a5f5-43277c08ba98] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:17:15.584602 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_api:SELECT=33,nova_api:UPDATE=1 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:17:15.590679 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fab57b2b-fb69-468d-832a-227c4133afad tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:17:15.591325 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fab57b2b-fb69-468d-832a-227c4133afad tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:17:15.591861 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fab57b2b-fb69-468d-832a-227c4133afad tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:17:15.592681 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fab57b2b-fb69-468d-832a-227c4133afad tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:17:15.593293 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fab57b2b-fb69-468d-832a-227c4133afad tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:17:15.593712 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-fab57b2b-fb69-468d-832a-227c4133afad tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:17:15.597176 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell1:SELECT=85,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:17:15.784464 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-fab57b2b-fb69-468d-832a-227c4133afad tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3333a4ba4204c80ac03c960bfb77ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bf0e348b4944e8907b80446a12a6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:17:15.792165 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-fab57b2b-fb69-468d-832a-227c4133afad tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] 10.222.0.42 "GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98" status: 200 len: 1560 microversion: 2.1 time: 0.214910 Sep 16 02:17:15.792816 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 606/1202] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:17:15 2022] GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98 => generated 1560 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:18:43.639225 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_api:SELECT=1 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:18:43.643678 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-5c58fac5-f5b3-4f4e-b888-66c16600e5ad tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:18:43.645266 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG dbcounter [-] [120441] Writing DB stats nova_cell1:SELECT=5 {{(pid=120441) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:18:43.645566 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-5c58fac5-f5b3-4f4e-b888-66c16600e5ad tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] [instance: 4dc692c5-9b00-4551-a5f5-43277c08ba98] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:18:43.646883 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: Server unexpectedly closed connection Sep 16 02:18:43.647051 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: Fri Sep 16 02:18:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/os-server-external-events (ip 10.222.0.42) !!! Sep 16 02:18:43.651833 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_api:SELECT=30 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:18:43.652538 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG dbcounter [-] [120440] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=120440) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 02:18:43.653059 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [req-72611a50-c82f-4526-9eaa-ada1a9460c09 req-e93fca51-3104-4d3d-84f6-c3c79d7cc6d3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4dc692c5-9b00-4551-a5f5-43277c08ba98", "tag": "4c2f2ad7-8720-4f8e-9294-ca860089689f"}]} {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:18:43.653617 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 02:18:43.653758 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Fri Sep 16 02:18:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98 (ip 10.222.0.42) !!! Sep 16 02:18:43.655059 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 02:18:43.655059 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Fri Sep 16 02:18:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98 (ip 10.222.0.42) !!! Sep 16 02:18:43.658424 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-5c58fac5-f5b3-4f4e-b888-66c16600e5ad tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:18:43.658932 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-5c58fac5-f5b3-4f4e-b888-66c16600e5ad tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:18:43.659353 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-5c58fac5-f5b3-4f4e-b888-66c16600e5ad tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:18:43.660107 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-5c58fac5-f5b3-4f4e-b888-66c16600e5ad tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:18:43.660563 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-5c58fac5-f5b3-4f4e-b888-66c16600e5ad tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:18:43.661021 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-5c58fac5-f5b3-4f4e-b888-66c16600e5ad tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:18:43.666053 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-72611a50-c82f-4526-9eaa-ada1a9460c09 req-e93fca51-3104-4d3d-84f6-c3c79d7cc6d3 service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:18:43.667367 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-72611a50-c82f-4526-9eaa-ada1a9460c09 req-e93fca51-3104-4d3d-84f6-c3c79d7cc6d3 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:18:43.667882 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [req-72611a50-c82f-4526-9eaa-ada1a9460c09 req-e93fca51-3104-4d3d-84f6-c3c79d7cc6d3 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:18:43.682092 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.compute.server_external_events [req-72611a50-c82f-4526-9eaa-ada1a9460c09 req-e93fca51-3104-4d3d-84f6-c3c79d7cc6d3 service nova] Creating event network-changed:4c2f2ad7-8720-4f8e-9294-ca860089689f for instance 4dc692c5-9b00-4551-a5f5-43277c08ba98 on hv-cinder-84914 Sep 16 02:18:43.687831 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [req-72611a50-c82f-4526-9eaa-ada1a9460c09 req-e93fca51-3104-4d3d-84f6-c3c79d7cc6d3 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.050049 Sep 16 02:18:43.688479 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 607/1203] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:18:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 02:18:43.697185 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-5c58fac5-f5b3-4f4e-b888-66c16600e5ad tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] [instance: 4dc692c5-9b00-4551-a5f5-43277c08ba98] Going to try to terminate instance {{(pid=120440) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 02:18:43.789441 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-5c58fac5-f5b3-4f4e-b888-66c16600e5ad tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] 10.222.0.42 "DELETE /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98" status: 204 len: 0 microversion: 2.1 time: 0.153852 Sep 16 02:18:43.790305 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 597/1204] 10.222.0.42 () {58 vars in 1239 bytes} [Fri Sep 16 02:18:43 2022] DELETE /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98 => generated 0 bytes in 156 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 02:18:43.800418 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-88c44c3f-a9e8-4007-bb6f-40490eba616b tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:18:43.801264 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-88c44c3f-a9e8-4007-bb6f-40490eba616b tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] [instance: 4dc692c5-9b00-4551-a5f5-43277c08ba98] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:18:43.812187 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-88c44c3f-a9e8-4007-bb6f-40490eba616b tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:18:43.812752 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-88c44c3f-a9e8-4007-bb6f-40490eba616b tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:18:43.813190 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-88c44c3f-a9e8-4007-bb6f-40490eba616b tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:18:43.813957 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-88c44c3f-a9e8-4007-bb6f-40490eba616b tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:18:43.814413 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-88c44c3f-a9e8-4007-bb6f-40490eba616b tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:18:43.814895 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-88c44c3f-a9e8-4007-bb6f-40490eba616b tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:18:43.987986 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-88c44c3f-a9e8-4007-bb6f-40490eba616b tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3333a4ba4204c80ac03c960bfb77ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bf0e348b4944e8907b80446a12a6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:18:43.996242 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-88c44c3f-a9e8-4007-bb6f-40490eba616b tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] 10.222.0.42 "GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98" status: 200 len: 1566 microversion: 2.1 time: 0.200845 Sep 16 02:18:43.996826 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 608/1205] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:18:43 2022] GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98 => generated 1566 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 02:18:45.021345 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-b92a163c-37e5-494b-ae2c-ade20598d4c7 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:18:45.022045 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-b92a163c-37e5-494b-ae2c-ade20598d4c7 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] [instance: 4dc692c5-9b00-4551-a5f5-43277c08ba98] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:18:45.028789 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b92a163c-37e5-494b-ae2c-ade20598d4c7 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:18:45.029277 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b92a163c-37e5-494b-ae2c-ade20598d4c7 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:18:45.029712 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b92a163c-37e5-494b-ae2c-ade20598d4c7 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:18:45.030401 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b92a163c-37e5-494b-ae2c-ade20598d4c7 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:18:45.030849 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b92a163c-37e5-494b-ae2c-ade20598d4c7 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:18:45.031270 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-b92a163c-37e5-494b-ae2c-ade20598d4c7 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:18:45.171213 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.policy [None req-b92a163c-37e5-494b-ae2c-ade20598d4c7 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3333a4ba4204c80ac03c960bfb77ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bf0e348b4944e8907b80446a12a6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120440) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:18:45.179037 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-b92a163c-37e5-494b-ae2c-ade20598d4c7 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] 10.222.0.42 "GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98" status: 200 len: 1566 microversion: 2.1 time: 0.162030 Sep 16 02:18:45.179607 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 598/1206] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:18:45 2022] GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98 => generated 1566 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:18:46.202627 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-5ca82ef6-7aca-412f-9eb3-08c36d459415 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Calling method '>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:18:46.203836 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.compute.api [None req-5ca82ef6-7aca-412f-9eb3-08c36d459415 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] [instance: 4dc692c5-9b00-4551-a5f5-43277c08ba98] Fetching instance by UUID {{(pid=120441) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:18:46.210545 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5ca82ef6-7aca-412f-9eb3-08c36d459415 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:18:46.211252 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5ca82ef6-7aca-412f-9eb3-08c36d459415 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:18:46.211756 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5ca82ef6-7aca-412f-9eb3-08c36d459415 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:18:46.212568 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5ca82ef6-7aca-412f-9eb3-08c36d459415 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:18:46.213076 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5ca82ef6-7aca-412f-9eb3-08c36d459415 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:18:46.213583 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG oslo_concurrency.lockutils [None req-5ca82ef6-7aca-412f-9eb3-08c36d459415 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=120441) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:18:46.249252 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [req-eb406fb4-2770-4e31-a31d-723748402a89 req-e05871b8-06a7-465b-b2d4-f3fbed74cd51 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4dc692c5-9b00-4551-a5f5-43277c08ba98", "name": "network-vif-deleted", "tag": "4c2f2ad7-8720-4f8e-9294-ca860089689f"}]} {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 02:18:46.261742 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-eb406fb4-2770-4e31-a31d-723748402a89 req-e05871b8-06a7-465b-b2d4-f3fbed74cd51 service nova] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:18:46.262128 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-eb406fb4-2770-4e31-a31d-723748402a89 req-e05871b8-06a7-465b-b2d4-f3fbed74cd51 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:18:46.262556 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [req-eb406fb4-2770-4e31-a31d-723748402a89 req-e05871b8-06a7-465b-b2d4-f3fbed74cd51 service nova] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:18:46.280604 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.policy [None req-5ca82ef6-7aca-412f-9eb3-08c36d459415 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'c3333a4ba4204c80ac03c960bfb77ee3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f1bf0e348b4944e8907b80446a12a6ac', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=120441) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 02:18:46.284120 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.compute.server_external_events [req-eb406fb4-2770-4e31-a31d-723748402a89 req-e05871b8-06a7-465b-b2d4-f3fbed74cd51 service nova] Creating event network-vif-deleted:4c2f2ad7-8720-4f8e-9294-ca860089689f for instance 4dc692c5-9b00-4551-a5f5-43277c08ba98 on hv-cinder-84914 Sep 16 02:18:46.289128 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [req-eb406fb4-2770-4e31-a31d-723748402a89 req-e05871b8-06a7-465b-b2d4-f3fbed74cd51 service nova] 10.222.0.42 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044543 Sep 16 02:18:46.289726 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 599/1207] 10.222.0.42 () {64 vars in 1317 bytes} [Fri Sep 16 02:18:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 02:18:46.291078 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-5ca82ef6-7aca-412f-9eb3-08c36d459415 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] 10.222.0.42 "GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98" status: 200 len: 1380 microversion: 2.1 time: 0.092477 Sep 16 02:18:46.292873 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 609/1208] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:18:46 2022] GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98 => generated 1380 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 02:18:47.317320 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-cb00fad6-7be8-4348-8310-ec7c4c7b68b4 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Calling method '>' {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:18:47.318020 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.compute.api [None req-cb00fad6-7be8-4348-8310-ec7c4c7b68b4 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] [instance: 4dc692c5-9b00-4551-a5f5-43277c08ba98] Fetching instance by UUID {{(pid=120440) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 02:18:47.324904 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cb00fad6-7be8-4348-8310-ec7c4c7b68b4 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:18:47.325397 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cb00fad6-7be8-4348-8310-ec7c4c7b68b4 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:18:47.325836 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cb00fad6-7be8-4348-8310-ec7c4c7b68b4 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:18:47.326525 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cb00fad6-7be8-4348-8310-ec7c4c7b68b4 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Acquiring lock "c617f603-de26-4777-9f52-27e34617b162" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 02:18:47.326985 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cb00fad6-7be8-4348-8310-ec7c4c7b68b4 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 02:18:47.327409 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG oslo_concurrency.lockutils [None req-cb00fad6-7be8-4348-8310-ec7c4c7b68b4 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Lock "c617f603-de26-4777-9f52-27e34617b162" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=120440) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 02:18:47.340711 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.wsgi [None req-cb00fad6-7be8-4348-8310-ec7c4c7b68b4 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] HTTP exception thrown: Instance 4dc692c5-9b00-4551-a5f5-43277c08ba98 could not be found. Sep 16 02:18:47.342312 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-cb00fad6-7be8-4348-8310-ec7c4c7b68b4 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Request method failure captured: Sep 16 02:18:47.342312 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: request: GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98 HTTP/1.1 Sep 16 02:18:47.342312 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept: application/json Sep 16 02:18:47.342312 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Accept-Encoding: identity Sep 16 02:18:47.342312 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Connection: close Sep 16 02:18:47.342312 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Length: 0 Sep 16 02:18:47.342312 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Content-Type: application/json Sep 16 02:18:47.342312 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Host: 10.222.0.42 Sep 16 02:18:47.342312 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: Openstack-System-Scope: None Sep 16 02:18:47.342312 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: User-Agent: python-urllib3/1.26.12 Sep 16 02:18:47.342312 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Auth-Token: gAAAAABjI9vShIVvbM9bj4fm5S7IGQKdeYPfAZLMIhPysU2vVJ2ffGHK0kQK2t9CdHsXPUpV0I9pOpbbT9eIhFk1F1XPLJt5pg6g0QR9jXMsPRTOTUFPk3VUXG3z7cKKsLoVgRiAVd2PzSTv4gWwYLyEMFqOsqTkhYMMa3TJqznx9VvvRRHWWbM Sep 16 02:18:47.342312 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Id: None Sep 16 02:18:47.342312 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Domain-Name: None Sep 16 02:18:47.342312 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Identity-Status: Confirmed Sep 16 02:18:47.342312 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Is-Admin-Project: True Sep 16 02:18:47.342312 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Id: default Sep 16 02:18:47.342312 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Domain-Name: Default Sep 16 02:18:47.342312 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Id: f1bf0e348b4944e8907b80446a12a6ac Sep 16 02:18:47.342312 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Project-Name: tempest-TestShelveInstance-1255116296 Sep 16 02:18:47.342312 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Role: member,reader Sep 16 02:18:47.342312 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Roles: member,reader Sep 16 02:18:47.344222 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Service-Catalog: [{"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42:9696/networking"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2/f1bf0e348b4944e8907b80446a12a6ac"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f1bf0e348b4944e8907b80446a12a6ac"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "adminURL": "http://10.222.0.42:8080", "publicURL": "http://10.222.0.42:8080/v1/AUTH_f1bf0e348b4944e8907b80446a12a6ac"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/volume/v3/f1bf0e348b4944e8907b80446a12a6ac"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/placement"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/compute/v2.1"}]}, {"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/identity"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.42/image"}]}] Sep 16 02:18:47.344222 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant: tempest-TestShelveInstance-1255116296 Sep 16 02:18:47.344222 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Id: f1bf0e348b4944e8907b80446a12a6ac Sep 16 02:18:47.344222 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-Tenant-Name: tempest-TestShelveInstance-1255116296 Sep 16 02:18:47.344222 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User: tempest-TestShelveInstance-1255116296-project Sep 16 02:18:47.344222 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Id: default Sep 16 02:18:47.344222 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Domain-Name: Default Sep 16 02:18:47.344222 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Id: c3333a4ba4204c80ac03c960bfb77ee3 Sep 16 02:18:47.344222 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: X-User-Name: tempest-TestShelveInstance-1255116296-project Sep 16 02:18:47.344222 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: method: > Sep 16 02:18:47.344222 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: exception: Instance 4dc692c5-9b00-4551-a5f5-43277c08ba98 could not be found. Sep 16 02:18:47.344222 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: action_args: {'id': '4dc692c5-9b00-4551-a5f5-43277c08ba98'} Sep 16 02:18:47.345306 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: {{(pid=120440) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 02:18:47.345306 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:18:47.345306 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 02:18:47.345306 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 02:18:47.345306 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 02:18:47.345306 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 02:18:47.345306 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 02:18:47.345306 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 02:18:47.345306 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 02:18:47.345306 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 02:18:47.345306 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4dc692c5-9b00-4551-a5f5-43277c08ba98 could not be found. Sep 16 02:18:47.345306 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:18:47.345306 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:18:47.345306 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:18:47.345306 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:18:47.345306 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:18:47.345306 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:18:47.345306 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 02:18:47.345306 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 02:18:47.345306 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 02:18:47.347002 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 02:18:47.347002 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 02:18:47.347002 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 02:18:47.347002 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 02:18:47.347002 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 02:18:47.347002 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 02:18:47.347002 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 02:18:47.347002 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4dc692c5-9b00-4551-a5f5-43277c08ba98 could not be found. Sep 16 02:18:47.347002 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:18:47.347002 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 02:18:47.347002 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:18:47.347002 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 02:18:47.347002 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 02:18:47.347002 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 02:18:47.347002 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 02:18:47.347002 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 02:18:47.347002 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4dc692c5-9b00-4551-a5f5-43277c08ba98 could not be found. Sep 16 02:18:47.347002 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: ERROR nova.api.openstack.wsgi Sep 16 02:18:47.348543 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: DEBUG nova.api.openstack.wsgi [None req-cb00fad6-7be8-4348-8310-ec7c4c7b68b4 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Returning 404 to user: Instance 4dc692c5-9b00-4551-a5f5-43277c08ba98 could not be found. {{(pid=120440) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 02:18:47.348543 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: INFO nova.api.openstack.requestlog [None req-cb00fad6-7be8-4348-8310-ec7c4c7b68b4 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] 10.222.0.42 "GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98" status: 404 len: 111 microversion: 2.1 time: 0.031123 Sep 16 02:18:47.348543 dv-cinder-849143-2-iscsi devstack@n-api.service[120440]: [pid: 120440|app: 0|req: 600/1209] 10.222.0.42 () {58 vars in 1236 bytes} [Fri Sep 16 02:18:47 2022] GET /compute/v2.1/servers/4dc692c5-9b00-4551-a5f5-43277c08ba98 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 02:18:47.505341 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: DEBUG nova.api.openstack.wsgi [None req-790a9a3f-bca7-444d-a3d5-9f5d02dbd175 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] Calling method '.version_select at 0x7fae36223940>' {{(pid=120441) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 02:18:47.530715 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: INFO nova.api.openstack.requestlog [None req-790a9a3f-bca7-444d-a3d5-9f5d02dbd175 tempest-TestShelveInstance-1255116296 tempest-TestShelveInstance-1255116296-project] 10.222.0.42 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-103467745" status: 202 len: 0 microversion: 2.1 time: 0.028105 Sep 16 02:18:47.531377 dv-cinder-849143-2-iscsi devstack@n-api.service[120441]: [pid: 120441|app: 0|req: 610/1210] 10.222.0.42 () {58 vars in 1251 bytes} [Fri Sep 16 02:18:47 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-103467745 => generated 0 bytes in 31 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)